You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/03/15 00:56:46 UTC
[JENKINS] Lucene-Solr-Tests-trunk-Java6 - Build # 16004 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java6/16004/
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
No registered leader was found, collection:collection1 slice:shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found, collection:collection1 slice:shard1
at __randomizedtesting.SeedInfo.seed([5949ACF497AB2B3F:D8AF22ECE0F44B03]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:484)
at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:291)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:116)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 8744 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T2030 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 6 T2030 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1363304656708
[junit4:junit4] 2> 7 T2030 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 8 T2031 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 11 T2031 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 11 T2031 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 11 T2031 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 12 T2031 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 13 T2031 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 108 T2030 oasc.ZkTestServer.run start zk server on port:53052
[junit4:junit4] 2> 108 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3a748d4d
[junit4:junit4] 2> 109 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 110 T2036 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 110 T2036 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 111 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53053
[junit4:junit4] 2> 111 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53053
[junit4:junit4] 2> 112 T2034 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 140 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c0000 with negotiated timeout 10000 for client /140.211.11.196:53053
[junit4:junit4] 2> 140 T2036 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c0000, negotiated timeout = 10000
[junit4:junit4] 2> 141 T2037 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a748d4d name:ZooKeeperConnection Watcher:127.0.0.1:53052 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 141 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 142 T2030 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 151 T2035 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b4a2f4c0000
[junit4:junit4] 2> 152 T2037 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 152 T2030 oaz.ZooKeeper.close Session: 0x13d6b4a2f4c0000 closed
[junit4:junit4] 2> 153 T2032 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:53053 which had sessionid 0x13d6b4a2f4c0000
[junit4:junit4] 2> 153 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@23e31e9e
[junit4:junit4] 2> 154 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 154 T2038 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 155 T2038 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 155 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53054
[junit4:junit4] 2> 156 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53054
[junit4:junit4] 2> 157 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c0001 with negotiated timeout 10000 for client /140.211.11.196:53054
[junit4:junit4] 2> 157 T2038 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c0001, negotiated timeout = 10000
[junit4:junit4] 2> 157 T2039 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23e31e9e name:ZooKeeperConnection Watcher:127.0.0.1:53052/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 157 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 158 T2030 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 167 T2030 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 170 T2030 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 172 T2030 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 180 T2030 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 181 T2030 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 193 T2030 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 194 T2030 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 298 T2030 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 299 T2030 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 302 T2030 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 303 T2030 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 313 T2030 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 313 T2030 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 316 T2030 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 317 T2030 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 320 T2030 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 320 T2030 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 323 T2030 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 324 T2030 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 327 T2030 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 327 T2030 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 335 T2035 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b4a2f4c0001
[junit4:junit4] 2> 335 T2039 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 336 T2032 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:53054 which had sessionid 0x13d6b4a2f4c0001
[junit4:junit4] 2> 335 T2030 oaz.ZooKeeper.close Session: 0x13d6b4a2f4c0001 closed
[junit4:junit4] 2> 524 T2030 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 528 T2030 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:53055
[junit4:junit4] 2> 529 T2030 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 529 T2030 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 530 T2030 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363304657039
[junit4:junit4] 2> 530 T2030 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363304657039/solr.xml
[junit4:junit4] 2> 531 T2030 oasc.CoreContainer.<init> New CoreContainer 1017836972
[junit4:junit4] 2> 531 T2030 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363304657039/'
[junit4:junit4] 2> 532 T2030 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363304657039/'
[junit4:junit4] 2> 586 T2030 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 586 T2030 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 587 T2030 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 587 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 588 T2030 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 588 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 589 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 589 T2030 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 590 T2030 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 590 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 613 T2030 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 633 T2030 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53052/solr
[junit4:junit4] 2> 634 T2030 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 634 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7e5d2763
[junit4:junit4] 2> 635 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 636 T2049 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 636 T2049 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 637 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53056
[junit4:junit4] 2> 637 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53056
[junit4:junit4] 2> 639 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c0002 with negotiated timeout 20000 for client /140.211.11.196:53056
[junit4:junit4] 2> 639 T2049 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c0002, negotiated timeout = 20000
[junit4:junit4] 2> 640 T2050 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e5d2763 name:ZooKeeperConnection Watcher:127.0.0.1:53052 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 640 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 641 T2035 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b4a2f4c0002
[junit4:junit4] 2> 643 T2050 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 643 T2032 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:53056 which had sessionid 0x13d6b4a2f4c0002
[junit4:junit4] 2> 643 T2030 oaz.ZooKeeper.close Session: 0x13d6b4a2f4c0002 closed
[junit4:junit4] 2> 643 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 656 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6d10d74c
[junit4:junit4] 2> 656 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 657 T2051 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 657 T2051 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 658 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53057
[junit4:junit4] 2> 658 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53057
[junit4:junit4] 2> 659 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c0003 with negotiated timeout 20000 for client /140.211.11.196:53057
[junit4:junit4] 2> 659 T2051 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c0003, negotiated timeout = 20000
[junit4:junit4] 2> 660 T2052 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d10d74c name:ZooKeeperConnection Watcher:127.0.0.1:53052/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 660 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 662 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 671 T2030 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 673 T2030 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53055_
[junit4:junit4] 2> 674 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:53055_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:53055_
[junit4:junit4] 2> 675 T2030 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53055_
[junit4:junit4] 2> 685 T2030 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 698 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 699 T2030 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 702 T2030 oasc.Overseer.start Overseer (id=89345533982539779-127.0.0.1:53055_-n_0000000000) starting
[junit4:junit4] 2> 702 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 703 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 714 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 715 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 717 T2054 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 718 T2030 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 730 T2030 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 732 T2030 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 736 T2053 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 738 T2055 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363304657039/collection1
[junit4:junit4] 2> 738 T2055 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 739 T2055 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 739 T2055 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 740 T2055 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363304657039/collection1/'
[junit4:junit4] 2> 741 T2055 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363304657039/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 742 T2055 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363304657039/collection1/lib/README' to classloader
[junit4:junit4] 2> 792 T2055 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 854 T2055 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 955 T2055 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 965 T2055 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1619 T2055 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1628 T2055 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1632 T2055 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1641 T2055 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1644 T2055 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1648 T2055 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1648 T2055 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1649 T2055 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1649 T2055 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1650 T2055 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1650 T2055 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1650 T2055 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1650 T2055 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363304657039/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/control/data/
[junit4:junit4] 2> 1651 T2055 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@561777b1
[junit4:junit4] 2> 1651 T2055 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1651 T2055 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/control/data forceNew: false
[junit4:junit4] 2> 1652 T2055 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/control/data/index/
[junit4:junit4] 2> 1652 T2055 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1652 T2055 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/control/data/index forceNew: false
[junit4:junit4] 2> 1654 T2055 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3ed8833f lockFactory=org.apache.lucene.store.NativeFSLockFactory@667e13a2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1655 T2055 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1656 T2055 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1657 T2055 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1657 T2055 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1657 T2055 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1658 T2055 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1658 T2055 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1658 T2055 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1658 T2055 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1659 T2055 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1664 T2055 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1668 T2055 oass.SolrIndexSearcher.<init> Opening Searcher@fbe338f main
[junit4:junit4] 2> 1669 T2055 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/control/data/tlog
[junit4:junit4] 2> 1670 T2055 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1670 T2055 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1672 T2056 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fbe338f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1673 T2055 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1673 T2055 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1674 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2239 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2240 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:53055_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53055"}
[junit4:junit4] 2> 2240 T2053 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2240 T2053 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2240 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2254 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2687 T2055 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2687 T2055 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53055 collection:control_collection shard:shard1
[junit4:junit4] 2> 2688 T2055 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2704 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2705 T2055 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2705 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2708 T2055 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2708 T2055 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2708 T2055 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53055/collection1/
[junit4:junit4] 2> 2708 T2055 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2709 T2055 oasc.SyncStrategy.syncToMe http://127.0.0.1:53055/collection1/ has no replicas
[junit4:junit4] 2> 2709 T2055 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53055/collection1/
[junit4:junit4] 2> 2709 T2055 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2722 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3764 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3815 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3897 T2055 oasc.ZkController.register We are http://127.0.0.1:53055/collection1/ and leader is http://127.0.0.1:53055/collection1/
[junit4:junit4] 2> 3897 T2055 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53055
[junit4:junit4] 2> 3897 T2055 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3897 T2055 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3897 T2055 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3921 T2055 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3922 T2030 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3922 T2030 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3923 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3931 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3932 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@fad72f7
[junit4:junit4] 2> 3933 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3933 T2058 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 3934 T2058 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 3934 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53058
[junit4:junit4] 2> 3934 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53058
[junit4:junit4] 2> 3937 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c0004 with negotiated timeout 10000 for client /140.211.11.196:53058
[junit4:junit4] 2> 3937 T2058 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c0004, negotiated timeout = 10000
[junit4:junit4] 2> 3938 T2059 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fad72f7 name:ZooKeeperConnection Watcher:127.0.0.1:53052/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3938 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3940 T2030 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3942 T2030 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4080 T2030 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4082 T2030 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:53059
[junit4:junit4] 2> 4083 T2030 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4083 T2030 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4083 T2030 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644
[junit4:junit4] 2> 4084 T2030 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/solr.xml
[junit4:junit4] 2> 4084 T2030 oasc.CoreContainer.<init> New CoreContainer 183606507
[junit4:junit4] 2> 4084 T2030 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/'
[junit4:junit4] 2> 4085 T2030 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/'
[junit4:junit4] 2> 4122 T2030 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4122 T2030 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4122 T2030 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4123 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4123 T2030 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4123 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4124 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4124 T2030 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4124 T2030 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4125 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4138 T2030 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4152 T2030 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53052/solr
[junit4:junit4] 2> 4152 T2030 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4153 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@68e47bd4
[junit4:junit4] 2> 4153 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4154 T2069 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4154 T2069 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 4155 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53060
[junit4:junit4] 2> 4155 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53060
[junit4:junit4] 2> 4160 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c0005 with negotiated timeout 20000 for client /140.211.11.196:53060
[junit4:junit4] 2> 4160 T2069 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c0005, negotiated timeout = 20000
[junit4:junit4] 2> 4161 T2070 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68e47bd4 name:ZooKeeperConnection Watcher:127.0.0.1:53052 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4161 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4162 T2035 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b4a2f4c0005
[junit4:junit4] 2> 4177 T2070 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4177 T2032 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:53060 which had sessionid 0x13d6b4a2f4c0005
[junit4:junit4] 2> 4177 T2030 oaz.ZooKeeper.close Session: 0x13d6b4a2f4c0005 closed
[junit4:junit4] 2> 4178 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4188 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@20b405ff
[junit4:junit4] 2> 4189 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4189 T2071 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4190 T2071 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 4190 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53061
[junit4:junit4] 2> 4190 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53061
[junit4:junit4] 2> 4192 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c0006 with negotiated timeout 20000 for client /140.211.11.196:53061
[junit4:junit4] 2> 4192 T2071 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c0006, negotiated timeout = 20000
[junit4:junit4] 2> 4192 T2072 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20b405ff name:ZooKeeperConnection Watcher:127.0.0.1:53052/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4193 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4194 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4196 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4198 T2030 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5202 T2030 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53059_
[junit4:junit4] 2> 5202 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:53059_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:53059_
[junit4:junit4] 2> 5206 T2030 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53059_
[junit4:junit4] 2> 5216 T2052 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5216 T2072 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5216 T2059 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5216 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5221 T2073 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/collection1
[junit4:junit4] 2> 5221 T2073 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5222 T2073 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5222 T2073 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5223 T2073 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/collection1/'
[junit4:junit4] 2> 5224 T2073 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5224 T2073 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/collection1/lib/README' to classloader
[junit4:junit4] 2> 5257 T2073 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5297 T2073 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5367 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5368 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:53055_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53055"}
[junit4:junit4] 2> 5371 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5372 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5398 T2073 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5398 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5402 T2073 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5820 T2073 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5828 T2073 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5831 T2073 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5843 T2073 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5846 T2073 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5849 T2073 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5850 T2073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5851 T2073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5851 T2073 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5852 T2073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5852 T2073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5853 T2073 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5853 T2073 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty1/
[junit4:junit4] 2> 5853 T2073 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@561777b1
[junit4:junit4] 2> 5853 T2073 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5854 T2073 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty1 forceNew: false
[junit4:junit4] 2> 5854 T2073 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty1/index/
[junit4:junit4] 2> 5854 T2073 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5855 T2073 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty1/index forceNew: false
[junit4:junit4] 2> 5863 T2073 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1c5fdc11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@780b7ed7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5863 T2073 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5865 T2073 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5865 T2073 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5865 T2073 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5866 T2073 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5866 T2073 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5866 T2073 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5867 T2073 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5867 T2073 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5867 T2073 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5872 T2073 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5876 T2073 oass.SolrIndexSearcher.<init> Opening Searcher@55a68f4c main
[junit4:junit4] 2> 5876 T2073 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty1/tlog
[junit4:junit4] 2> 5877 T2073 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5877 T2073 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5879 T2074 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@55a68f4c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5881 T2073 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5881 T2073 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6875 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6876 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:53059_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53059"}
[junit4:junit4] 2> 6876 T2053 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6877 T2053 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6895 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6895 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6895 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7885 T2073 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7885 T2073 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53059 collection:collection1 shard:shard1
[junit4:junit4] 2> 7886 T2073 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7909 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7915 T2073 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7915 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7918 T2073 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7918 T2073 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7919 T2073 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53059/collection1/
[junit4:junit4] 2> 7919 T2073 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7919 T2073 oasc.SyncStrategy.syncToMe http://127.0.0.1:53059/collection1/ has no replicas
[junit4:junit4] 2> 7919 T2073 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53059/collection1/
[junit4:junit4] 2> 7920 T2073 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7929 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8400 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8416 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8416 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8416 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8447 T2073 oasc.ZkController.register We are http://127.0.0.1:53059/collection1/ and leader is http://127.0.0.1:53059/collection1/
[junit4:junit4] 2> 8447 T2073 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53059
[junit4:junit4] 2> 8447 T2073 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8447 T2073 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8448 T2073 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8450 T2073 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8451 T2030 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 8452 T2030 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8452 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8659 T2030 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8662 T2030 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43851
[junit4:junit4] 2> 8663 T2030 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8663 T2030 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8664 T2030 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363304665170
[junit4:junit4] 2> 8664 T2030 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363304665170/solr.xml
[junit4:junit4] 2> 8665 T2030 oasc.CoreContainer.<init> New CoreContainer 638331777
[junit4:junit4] 2> 8665 T2030 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363304665170/'
[junit4:junit4] 2> 8666 T2030 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363304665170/'
[junit4:junit4] 2> 8714 T2030 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8715 T2030 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8715 T2030 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8716 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8716 T2030 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8716 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8717 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8717 T2030 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8718 T2030 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8718 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8744 T2030 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8766 T2030 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53052/solr
[junit4:junit4] 2> 8767 T2030 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8768 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@62761bf
[junit4:junit4] 2> 8769 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8769 T2085 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8770 T2085 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 8771 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:47433
[junit4:junit4] 2> 8771 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:47433
[junit4:junit4] 2> 8818 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c0007 with negotiated timeout 20000 for client /140.211.11.196:47433
[junit4:junit4] 2> 8818 T2085 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c0007, negotiated timeout = 20000
[junit4:junit4] 2> 8819 T2086 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62761bf name:ZooKeeperConnection Watcher:127.0.0.1:53052 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8819 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8821 T2035 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b4a2f4c0007
[junit4:junit4] 2> 8846 T2086 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8846 T2032 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:47433 which had sessionid 0x13d6b4a2f4c0007
[junit4:junit4] 2> 8846 T2030 oaz.ZooKeeper.close Session: 0x13d6b4a2f4c0007 closed
[junit4:junit4] 2> 8847 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8860 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3fe8f8e7
[junit4:junit4] 2> 8861 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8862 T2087 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8862 T2087 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 8863 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:25259
[junit4:junit4] 2> 8863 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:25259
[junit4:junit4] 2> 8871 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c0008 with negotiated timeout 20000 for client /140.211.11.196:25259
[junit4:junit4] 2> 8871 T2087 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c0008, negotiated timeout = 20000
[junit4:junit4] 2> 8871 T2088 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3fe8f8e7 name:ZooKeeperConnection Watcher:127.0.0.1:53052/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8872 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8873 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8920 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8922 T2030 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9926 T2030 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43851_
[junit4:junit4] 2> 9927 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:43851_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:43851_
[junit4:junit4] 2> 9929 T2030 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43851_
[junit4:junit4] 2> 9932 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9932 T2059 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9932 T2088 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9932 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9932 T2072 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9933 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:53059_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53059"}
[junit4:junit4] 2> 9933 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9946 T2089 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363304665170/collection1
[junit4:junit4] 2> 9946 T2089 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9948 T2089 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9949 T2089 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9950 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9950 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9950 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9950 T2089 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363304665170/collection1/'
[junit4:junit4] 2> 9952 T2089 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363304665170/collection1/lib/README' to classloader
[junit4:junit4] 2> 9952 T2089 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363304665170/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9953 T2052 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9953 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9954 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9999 T2089 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 10055 T2089 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10156 T2089 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10162 T2089 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10770 T2089 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10782 T2089 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10786 T2089 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10800 T2089 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10805 T2089 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10810 T2089 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10811 T2089 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10812 T2089 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10812 T2089 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10813 T2089 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10814 T2089 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10814 T2089 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 10814 T2089 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363304665170/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty2/
[junit4:junit4] 2> 10815 T2089 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@561777b1
[junit4:junit4] 2> 10815 T2089 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 10816 T2089 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty2 forceNew: false
[junit4:junit4] 2> 10816 T2089 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty2/index/
[junit4:junit4] 2> 10816 T2089 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10817 T2089 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty2/index forceNew: false
[junit4:junit4] 2> 10819 T2089 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2074bda8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f9384fc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10820 T2089 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10822 T2089 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10822 T2089 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10823 T2089 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10824 T2089 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10825 T2089 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10825 T2089 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10826 T2089 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10827 T2089 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10827 T2089 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10840 T2089 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10849 T2089 oass.SolrIndexSearcher.<init> Opening Searcher@62dce75 main
[junit4:junit4] 2> 10849 T2089 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty2/tlog
[junit4:junit4] 2> 10851 T2089 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10851 T2089 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10857 T2090 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@62dce75 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10860 T2089 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10861 T2089 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11456 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11457 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:43851_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43851"}
[junit4:junit4] 2> 11457 T2053 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11457 T2053 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 11473 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11473 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11473 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11473 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11864 T2089 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11864 T2089 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43851 collection:collection1 shard:shard2
[junit4:junit4] 2> 11865 T2089 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 11870 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 11871 T2089 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11871 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11873 T2089 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11874 T2089 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11874 T2089 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43851/collection1/
[junit4:junit4] 2> 11874 T2089 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11874 T2089 oasc.SyncStrategy.syncToMe http://127.0.0.1:43851/collection1/ has no replicas
[junit4:junit4] 2> 11874 T2089 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43851/collection1/
[junit4:junit4] 2> 11874 T2089 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 11877 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12978 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12994 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12994 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12994 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12994 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13010 T2089 oasc.ZkController.register We are http://127.0.0.1:43851/collection1/ and leader is http://127.0.0.1:43851/collection1/
[junit4:junit4] 2> 13010 T2089 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43851
[junit4:junit4] 2> 13010 T2089 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 13010 T2089 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 13011 T2089 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13012 T2089 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13013 T2030 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 13014 T2030 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 13014 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 13215 T2030 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 13217 T2030 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:19225
[junit4:junit4] 2> 13218 T2030 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 13218 T2030 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 13219 T2030 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363304669730
[junit4:junit4] 2> 13219 T2030 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363304669730/solr.xml
[junit4:junit4] 2> 13220 T2030 oasc.CoreContainer.<init> New CoreContainer 1014281166
[junit4:junit4] 2> 13220 T2030 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363304669730/'
[junit4:junit4] 2> 13221 T2030 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363304669730/'
[junit4:junit4] 2> 13269 T2030 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 13270 T2030 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 13270 T2030 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 13271 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 13271 T2030 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 13272 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 13272 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 13273 T2030 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 13273 T2030 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 13274 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 13293 T2030 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 13311 T2030 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53052/solr
[junit4:junit4] 2> 13312 T2030 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 13312 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@10c1b65b
[junit4:junit4] 2> 13313 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13314 T2101 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 13314 T2101 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 13315 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:35736
[junit4:junit4] 2> 13315 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:35736
[junit4:junit4] 2> 13317 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c0009 with negotiated timeout 20000 for client /140.211.11.196:35736
[junit4:junit4] 2> 13317 T2101 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c0009, negotiated timeout = 20000
[junit4:junit4] 2> 13317 T2102 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10c1b65b name:ZooKeeperConnection Watcher:127.0.0.1:53052 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13318 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13319 T2035 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b4a2f4c0009
[junit4:junit4] 2> 13320 T2102 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 13321 T2032 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:35736 which had sessionid 0x13d6b4a2f4c0009
[junit4:junit4] 2> 13320 T2030 oaz.ZooKeeper.close Session: 0x13d6b4a2f4c0009 closed
[junit4:junit4] 2> 13321 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 13331 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@43bdb9f3
[junit4:junit4] 2> 13332 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13332 T2103 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 13333 T2103 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 13333 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:14388
[junit4:junit4] 2> 13333 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:14388
[junit4:junit4] 2> 13334 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c000a with negotiated timeout 20000 for client /140.211.11.196:14388
[junit4:junit4] 2> 13334 T2103 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c000a, negotiated timeout = 20000
[junit4:junit4] 2> 13335 T2104 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43bdb9f3 name:ZooKeeperConnection Watcher:127.0.0.1:53052/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13335 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13336 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13337 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13339 T2030 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14343 T2030 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:19225_
[junit4:junit4] 2> 14344 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c000a type:delete cxid:0xb zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:19225_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:19225_
[junit4:junit4] 2> 14348 T2030 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:19225_
[junit4:junit4] 2> 14352 T2072 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14352 T2059 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14352 T2088 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14352 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14352 T2104 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14352 T2052 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14353 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14352 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14353 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14360 T2105 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363304669730/collection1
[junit4:junit4] 2> 14360 T2105 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14361 T2105 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14361 T2105 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14362 T2105 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363304669730/collection1/'
[junit4:junit4] 2> 14363 T2105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363304669730/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14364 T2105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363304669730/collection1/lib/README' to classloader
[junit4:junit4] 2> 14411 T2105 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14468 T2105 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14508 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14509 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:43851_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43851"}
[junit4:junit4] 2> 14521 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14521 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14521 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14521 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14569 T2105 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14569 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14575 T2105 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15643 T2105 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15660 T2105 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15666 T2105 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15681 T2105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15688 T2105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15694 T2105 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15696 T2105 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15697 T2105 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15697 T2105 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15698 T2105 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15698 T2105 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15699 T2105 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15699 T2105 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363304669730/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty3/
[junit4:junit4] 2> 15699 T2105 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@561777b1
[junit4:junit4] 2> 15700 T2105 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15701 T2105 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty3 forceNew: false
[junit4:junit4] 2> 15701 T2105 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty3/index/
[junit4:junit4] 2> 15701 T2105 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15701 T2105 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty3/index forceNew: false
[junit4:junit4] 2> 15706 T2105 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@431ca8ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@31417dd9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15706 T2105 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15709 T2105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15710 T2105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15710 T2105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15711 T2105 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15712 T2105 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15712 T2105 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15712 T2105 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15713 T2105 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15713 T2105 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15728 T2105 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15738 T2105 oass.SolrIndexSearcher.<init> Opening Searcher@e2554ff main
[junit4:junit4] 2> 15739 T2105 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty3/tlog
[junit4:junit4] 2> 15740 T2105 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15740 T2105 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15744 T2106 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e2554ff main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15746 T2105 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15746 T2105 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16026 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16027 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:19225_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19225"}
[junit4:junit4] 2> 16027 T2053 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 16028 T2053 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16043 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16043 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16043 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16043 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16045 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16774 T2105 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16774 T2105 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:19225 collection:collection1 shard:shard1
[junit4:junit4] 2> 16777 T2105 oasc.ZkController.register We are http://127.0.0.1:19225/collection1/ and leader is http://127.0.0.1:53059/collection1/
[junit4:junit4] 2> 16778 T2105 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:19225
[junit4:junit4] 2> 16778 T2105 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16778 T2105 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C115 name=collection1 org.apache.solr.core.SolrCore@8e20c43 url=http://127.0.0.1:19225/collection1 node=127.0.0.1:19225_ C115_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:19225_, base_url=http://127.0.0.1:19225}
[junit4:junit4] 2> 16778 T2107 C115 P19225 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16779 T2105 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16780 T2107 C115 P19225 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16780 T2107 C115 P19225 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16780 T2107 C115 P19225 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16781 T2030 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 16781 T2030 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16782 T2107 C115 P19225 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16782 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16988 T2030 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16991 T2030 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:31182
[junit4:junit4] 2> 16992 T2030 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16992 T2030 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16993 T2030 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363304673499
[junit4:junit4] 2> 16993 T2030 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363304673499/solr.xml
[junit4:junit4] 2> 16994 T2030 oasc.CoreContainer.<init> New CoreContainer 1142042302
[junit4:junit4] 2> 16994 T2030 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363304673499/'
[junit4:junit4] 2> 16995 T2030 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363304673499/'
[junit4:junit4] 2> 17043 T2030 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 17043 T2030 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 17044 T2030 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 17044 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 17044 T2030 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 17045 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 17045 T2030 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 17046 T2030 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 17046 T2030 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 17047 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 17066 T2030 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 17084 T2030 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53052/solr
[junit4:junit4] 2> 17084 T2030 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 17085 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@48129807
[junit4:junit4] 2> 17086 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17087 T2118 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 17088 T2118 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 17088 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:31183
[junit4:junit4] 2> 17088 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:31183
[junit4:junit4] 2> 17090 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c000b with negotiated timeout 20000 for client /140.211.11.196:31183
[junit4:junit4] 2> 17090 T2118 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c000b, negotiated timeout = 20000
[junit4:junit4] 2> 17091 T2119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48129807 name:ZooKeeperConnection Watcher:127.0.0.1:53052 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17091 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17093 T2035 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b4a2f4c000b
[junit4:junit4] 2> 17104 T2119 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 17104 T2032 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:31183 which had sessionid 0x13d6b4a2f4c000b
[junit4:junit4] 2> 17104 T2030 oaz.ZooKeeper.close Session: 0x13d6b4a2f4c000b closed
[junit4:junit4] 2> 17105 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 17114 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@26a17f04
[junit4:junit4] 2> 17115 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17115 T2120 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 17116 T2120 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 17116 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:31184
[junit4:junit4] 2> 17117 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:31184
[junit4:junit4] 2> 17118 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c000c with negotiated timeout 20000 for client /140.211.11.196:31184
[junit4:junit4] 2> 17118 T2120 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c000c, negotiated timeout = 20000
[junit4:junit4] 2> 17118 T2121 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26a17f04 name:ZooKeeperConnection Watcher:127.0.0.1:53052/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17119 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17120 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c000c type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17125 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c000c type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17128 T2030 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17548 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17549 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:19225_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19225"}
[junit4:junit4] 2> 17562 T2121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17562 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17562 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17562 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17562 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17562 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17800 T2062 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:19225__collection1&state=recovering&nodeName=127.0.0.1:19225_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 18131 T2030 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:31182_
[junit4:junit4] 2> 18132 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c000c type:delete cxid:0xd zxid:0xa9 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:31182_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:31182_
[junit4:junit4] 2> 18134 T2030 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:31182_
[junit4:junit4] 2> 18137 T2072 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18138 T2121 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18138 T2052 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18138 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18138 T2088 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18138 T2059 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18137 T2104 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18138 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18139 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18138 T2121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18138 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18139 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18152 T2122 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363304673499/collection1
[junit4:junit4] 2> 18153 T2122 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 18153 T2122 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 18154 T2122 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 18155 T2122 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363304673499/collection1/'
[junit4:junit4] 2> 18156 T2122 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363304673499/collection1/lib/README' to classloader
[junit4:junit4] 2> 18157 T2122 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363304673499/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 18215 T2122 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 18284 T2122 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18385 T2122 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18392 T2122 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 19132 T2122 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19140 T2122 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19143 T2122 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19153 T2122 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19156 T2122 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19159 T2122 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19160 T2122 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19161 T2122 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19161 T2122 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19162 T2122 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19162 T2122 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19162 T2122 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19162 T2122 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363304673499/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty4/
[junit4:junit4] 2> 19162 T2122 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@561777b1
[junit4:junit4] 2> 19163 T2122 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19163 T2122 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty4 forceNew: false
[junit4:junit4] 2> 19163 T2122 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty4/index/
[junit4:junit4] 2> 19164 T2122 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19164 T2122 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty4/index forceNew: false
[junit4:junit4] 2> 19166 T2122 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6c155fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b088353),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19166 T2122 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19168 T2122 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19168 T2122 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19168 T2122 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19169 T2122 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19169 T2122 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19169 T2122 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19170 T2122 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19170 T2122 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19170 T2122 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19175 T2122 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19179 T2122 oass.SolrIndexSearcher.<init> Opening Searcher@63efc277 main
[junit4:junit4] 2> 19179 T2122 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty4/tlog
[junit4:junit4] 2> 19180 T2122 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19180 T2122 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19183 T2123 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@63efc277 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19184 T2122 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 19184 T2122 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> C115_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:19225_, base_url=http://127.0.0.1:19225}
[junit4:junit4] 2> 19802 T2107 C115 P19225 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:53059/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19802 T2107 C115 P19225 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:19225 START replicas=[http://127.0.0.1:53059/collection1/] nUpdates=100
[junit4:junit4] 2> 19802 T2107 C115 P19225 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19803 T2107 C115 P19225 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19803 T2107 C115 P19225 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19803 T2107 C115 P19225 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19803 T2107 C115 P19225 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19804 T2107 C115 P19225 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:53059/collection1/. core=collection1
[junit4:junit4] 2> 19804 T2107 C115 P19225 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C116 name=collection1 org.apache.solr.core.SolrCore@4c40db3a url=http://127.0.0.1:53059/collection1 node=127.0.0.1:53059_ C116_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:53059_, base_url=http://127.0.0.1:53059, leader=true}
[junit4:junit4] 2> 19810 T2063 C116 P53059 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 19814 T2064 C116 P53059 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19815 T2064 C116 P53059 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1c5fdc11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@780b7ed7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19816 T2064 C116 P53059 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19817 T2064 C116 P53059 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1c5fdc11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@780b7ed7),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1c5fdc11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@780b7ed7),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19817 T2064 C116 P53059 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19817 T2064 C116 P53059 oass.SolrIndexSearcher.<init> Opening Searcher@5a102144 realtime
[junit4:junit4] 2> 19818 T2064 C116 P53059 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19818 T2064 C116 P53059 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 19819 T2107 C115 P19225 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19819 T2107 C115 P19225 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19821 T2065 C116 P53059 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19821 T2065 C116 P53059 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 19822 T2107 C115 P19225 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 19822 T2107 C115 P19225 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19822 T2107 C115 P19225 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19824 T2065 C116 P53059 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 19825 T2107 C115 P19225 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19826 T2107 C115 P19225 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty3/index.20130315104436527 forceNew: false
[junit4:junit4] 2> 19826 T2107 C115 P19225 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@32a07412 lockFactory=org.apache.lucene.store.NativeFSLockFactory@310e2306) fullCopy=false
[junit4:junit4] 2> 19829 T2065 C116 P53059 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 19830 T2107 C115 P19225 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19831 T2107 C115 P19225 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19831 T2107 C115 P19225 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19832 T2107 C115 P19225 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@431ca8ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@31417dd9),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@431ca8ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@31417dd9),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 19832 T2107 C115 P19225 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 19832 T2107 C115 P19225 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19832 T2107 C115 P19225 oass.SolrIndexSearcher.<init> Opening Searcher@10c7ac00 main
[junit4:junit4] 2> 19833 T2106 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10c7ac00 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 19833 T2107 C115 P19225 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@32a07412 lockFactory=org.apache.lucene.store.NativeFSLockFactory@310e2306)
[junit4:junit4] 2> 19833 T2107 C115 P19225 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19833 T2107 C115 P19225 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19834 T2107 C115 P19225 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19834 T2107 C115 P19225 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19840 T2107 C115 P19225 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20569 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20570 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:31182_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:31182"}
[junit4:junit4] 2> 20570 T2053 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 20571 T2053 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 20599 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:19225_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:19225"}
[junit4:junit4] 2> 20609 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20609 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20609 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20609 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20609 T2121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20609 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21188 T2122 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 21188 T2122 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:31182 collection:collection1 shard:shard2
[junit4:junit4] 2> 21192 T2122 oasc.ZkController.register We are http://127.0.0.1:31182/collection1/ and leader is http://127.0.0.1:43851/collection1/
[junit4:junit4] 2> 21192 T2122 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:31182
[junit4:junit4] 2> 21193 T2122 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 21193 T2122 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C117 name=collection1 org.apache.solr.core.SolrCore@58b736b url=http://127.0.0.1:31182/collection1 node=127.0.0.1:31182_ C117_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:31182_, base_url=http://127.0.0.1:31182}
[junit4:junit4] 2> 21193 T2126 C117 P31182 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 21194 T2122 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21194 T2126 C117 P31182 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 21195 T2126 C117 P31182 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 21195 T2126 C117 P31182 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 21195 T2030 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 21196 T2030 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 21196 T2126 C117 P31182 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21197 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21212 T2030 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21213 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21224 T2066 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/onenodecollectioncore
[junit4:junit4] 2> 21224 T2066 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 21225 T2066 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 21225 T2066 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 21226 T2066 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 21226 T2066 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 21229 T2066 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 21231 T2066 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/onenodecollectioncore/'
[junit4:junit4] 2> 21291 T2066 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 21347 T2066 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 21448 T2066 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 21454 T2066 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 22068 T2066 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 22080 T2066 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 22085 T2066 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 22099 T2066 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 22104 T2066 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 22109 T2066 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 22110 T2066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 22111 T2066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 22111 T2066 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 22112 T2066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 22113 T2066 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 22113 T2066 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 22113 T2066 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363304660644/onenodecollectioncore/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1363304656708/onenodecollection/
[junit4:junit4] 2> 22114 T2066 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@561777b1
[junit4:junit4] 2> 22114 T2066 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 22115 T2066 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1363304656708/onenodecollection forceNew: false
[junit4:junit4] 2> 22116 T2066 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1363304656708/onenodecollection/index/
[junit4:junit4] 2> 22116 T2066 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1363304656708/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 22117 T2066 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1363304656708/onenodecollection/index forceNew: false
[junit4:junit4] 2> 22119 T2066 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3c88f6b0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@43ea8b62),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22120 T2066 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22122 T2066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 22122 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22122 T2066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 22123 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:31182_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:31182"}
[junit4:junit4] 2> 22123 T2066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 22124 T2066 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 22124 T2066 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 22125 T2066 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 22125 T2066 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 22126 T2066 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 22126 T2066 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 22127 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22127 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22128 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22128 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22128 T2121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22127 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22133 T2066 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 22138 T2066 oass.SolrIndexSearcher.<init> Opening Searcher@6c7cb8d2 main
[junit4:junit4] 2> 22139 T2066 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1363304656708/onenodecollection/tlog
[junit4:junit4] 2> 22140 T2066 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 22140 T2066 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 22143 T2128 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@6c7cb8d2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 22145 T2066 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 22214 T2078 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:31182__collection1&state=recovering&nodeName=127.0.0.1:31182_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 23632 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23633 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:53059_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53059"}
[junit4:junit4] 2> 23634 T2053 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 23634 T2053 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 23638 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23638 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23638 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23638 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23638 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23638 T2121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24148 T2066 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 24149 T2066 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:53059 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 24150 T2066 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 24197 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0006 type:delete cxid:0xaa zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> C117_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:31182_, base_url=http://127.0.0.1:31182}
[junit4:junit4] 2> 24215 T2126 C117 P31182 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43851/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 24215 T2126 C117 P31182 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:31182 START replicas=[http://127.0.0.1:43851/collection1/] nUpdates=100
[junit4:junit4] 2> 24216 T2126 C117 P31182 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 24216 T2126 C117 P31182 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 24216 T2126 C117 P31182 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 24216 T2126 C117 P31182 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 24216 T2126 C117 P31182 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 24217 T2126 C117 P31182 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43851/collection1/. core=collection1
[junit4:junit4] 2> 24217 T2126 C117 P31182 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C118 name=collection1 org.apache.solr.core.SolrCore@43f14fd8 url=http://127.0.0.1:43851/collection1 node=127.0.0.1:43851_ C118_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:43851_, base_url=http://127.0.0.1:43851, leader=true}
[junit4:junit4] 2> 24223 T2079 C118 P43851 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 24223 T2066 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 24224 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0006 type:create cxid:0xab zxid:0xc6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 24226 T2066 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 24226 T2066 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 24227 T2066 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53059/onenodecollectioncore/
[junit4:junit4] 2> 24227 T2066 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 24227 T2066 oasc.SyncStrategy.syncToMe http://127.0.0.1:53059/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 24228 T2066 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53059/onenodecollectioncore/
[junit4:junit4] 2> 24228 T2066 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 24232 T2080 C118 P43851 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24232 T2035 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6b4a2f4c0006 type:create cxid:0xb5 zxid:0xca txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 24234 T2080 C118 P43851 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2074bda8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f9384fc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 24234 T2080 C118 P43851 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 24235 T2080 C118 P43851 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2074bda8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f9384fc),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2074bda8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f9384fc),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24236 T2080 C118 P43851 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24236 T2080 C118 P43851 oass.SolrIndexSearcher.<init> Opening Searcher@655304f4 realtime
[junit4:junit4] 2> 24237 T2080 C118 P43851 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24237 T2080 C118 P43851 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 24238 T2126 C117 P31182 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24238 T2126 C117 P31182 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 24239 T2081 C118 P43851 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24240 T2081 C118 P43851 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 24240 T2126 C117 P31182 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 24240 T2126 C117 P31182 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 24241 T2126 C117 P31182 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 24243 T2081 C118 P43851 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 24244 T2126 C117 P31182 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 24245 T2126 C117 P31182 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363304656708/jetty4/index.20130315104440946 forceNew: false
[junit4:junit4] 2> 24245 T2126 C117 P31182 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3efb3cc9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e9893dc) fullCopy=false
[junit4:junit4] 2> 24248 T2081 C118 P43851 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 24249 T2126 C117 P31182 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 24250 T2126 C117 P31182 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 24250 T2126 C117 P31182 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 24251 T2126 C117 P31182 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6c155fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b088353),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6c155fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b088353),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24252 T2126 C117 P31182 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24252 T2126 C117 P31182 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 24252 T2126 C117 P31182 oass.SolrIndexSearcher.<init> Opening Searcher@7f7d44a8 main
[junit4:junit4] 2> 24253 T2123 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f7d44a8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 24254 T2126 C117 P31182 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@3efb3cc9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1e9893dc)
[junit4:junit4] 2> 24254 T2126 C117 P31182 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 24254 T2126 C117 P31182 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 24254 T2126 C117 P31182 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 24254 T2126 C117 P31182 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 24261 T2126 C117 P31182 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 25142 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25157 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:31182_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:31182"}
[junit4:junit4] 2> 25169 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25169 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25169 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25169 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25169 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25169 T2121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25179 T2066 oasc.ZkController.register We are http://127.0.0.1:53059/onenodecollectioncore/ and leader is http://127.0.0.1:53059/onenodecollectioncore/
[junit4:junit4] 2> 25179 T2066 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:53059
[junit4:junit4] 2> 25179 T2066 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 25180 T2066 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 25182 T2066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25183 T2066 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=1&roles=none&name=onenodecollectioncore&action=CREATE&collection=onenodecollection&dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1363304656708/onenodecollection&wt=javabin&version=2} status=0 QTime=3960
[junit4:junit4] 2> 25183 T2030 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 25184 T2030 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26186 T2030 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26685 T2053 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26686 T2053 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:53059_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:53059"}
[junit4:junit4] 2> 26699 T2052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26699 T2088 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26699 T2072 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26699 T2121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26699 T2104 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26699 T2059 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 27189 T2030 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27190 T2030 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 27191 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C119 name=onenodecollectioncore org.apache.solr.core.SolrCore@3735df92 url=http://127.0.0.1:53059/onenodecollectioncore node=127.0.0.1:53059_ C119_STATE=coll:onenodecollection core:onenodecollectioncore props:{shard=shard1, roles=none, state=active, core=onenodecollectioncore, collection=onenodecollection, node_name=127.0.0.1:53059_, base_url=http://127.0.0.1:53059, leader=true}
[junit4:junit4] 2> 27206 T2067 C119 P53059 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3c88f6b0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@43ea8b62),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 27206 T2067 C119 P53059 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 27208 T2067 C119 P53059 /update {wt=javabin&version=2} {add=[1 (1429528572231417856)]} 0 4
[junit4:junit4] 2> 27211 T2067 C119 P53059 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27213 T2067 C119 P53059 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3c88f6b0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@43ea8b62),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3c88f6b0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@43ea8b62),segFN=segments_2,generation=2,filenames=[_0.fnm, _0.dvd, _0.nvm, _0.dvm, _0.pos, _0.nvd, _0.tim, segments_2, _0.fdx, _0.si, _0.tip, _0.doc, _0.fdt]
[junit4:junit4] 2> 27213 T2067 C119 P53059 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0.dvd, _0.nvm, _0.dvm, _0.pos, _0.nvd, _0.tim, segments_2, _0.fdx, _0.si, _0.tip, _0.doc, _0.fdt]
[junit4:junit4] 2> 27214 T2067 C119 P53059 oass.SolrIndexSearcher.<init> Opening Searcher@5f4e1839 main
[junit4:junit4] 2> 27214 T2067 C119 P53059 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27215 T2128 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@5f4e1839 main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4] 2> 27215 T2067 C119 P53059 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 27219 T2067 C119 P53059 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4:junit4] 2> 27219 T2030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 27228 T2067 C119 P53059 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C120 name=collection1 org.apache.solr.core.SolrCore@79ab0dc3 url=http://127.0.0.1:53055/collection1 node=127.0.0.1:53055_ C120_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:53055_, base_url=http://127.0.0.1:53055, leader=true}
[junit4:junit4] 2> 27235 T2042 C120 P53055 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3ed8833f lockFactory=org.apache.lucene.store.NativeFSLockFactory@667e13a2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 27235 T2042 C120 P53055 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 27238 T2042 C120 P53055 /update {wt=javabin&version=2} {add=[1 (1429528572262875136)]} 0 5
[junit4:junit4] 2> C115_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:19225_, base_url=http://127.0.0.1:19225}
[junit4:junit4] 2> 27256 T2094 C115 P19225 /update {distrib.from=http://127.0.0.1:53059/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429528572274409472)]} 0 2
[junit4:junit4] 2> 27257 T2068 C116 P53059 /update {wt=javabin&version=2} {add=[1 (1429528572274409472)]} 0 12
[junit4:junit4] 2> 27260 T2042 C120 P53055 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27263 T2042 C120 P53055 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3ed8833f lockFactory=org.apache.lucene.store.NativeFSLockFactory@667e13a2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3ed8833f lockFactory=org.apache.lucene.store.NativeFSLockFactory@667e13a2),segFN=segments_2,generation=2,filenames=[_0.fnm, _0.dvd, _0.nvm, _0.dvm, _0.pos, _0.nvd, _0.tim, segments_2, _0.fdx, _0.si, _0.tip, _0.doc, _0.fdt]
[junit4:junit4] 2> 27263 T2042 C120 P53055 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0.fnm, _0.dvd, _0.nvm, _0.dvm, _0.pos, _0.nvd, _0.tim, segments_2, _0.fdx, _0.si, _0.tip, _0.doc, _0.fdt]
[junit4:junit4] 2> 27264 T2042 C120 P53055 oass.SolrIndexSearcher.<init> Opening Searcher@4101c2fa main
[junit4:junit4] 2> 27264 T2042 C120 P53055 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27265 T2056 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4101c2fa main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4] 2> 27265 T2042 C120 P53055 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 27266 T2084 C118 P43851 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27267 T2084 C118 P43851 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2074bda8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f9384fc),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2074bda8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f9384fc),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 27268 T2084 C118 P43851 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 27268 T2084 C118 P43851 oass.SolrIndexSearcher.<init> Opening Searcher@215dbf46 main
[junit4:junit4] 2> 27268 T2084 C118 P43851 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27269 T2090 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@215dbf46 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 27270 T2084 C118 P43851 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:53059/collection1/, StdNode: http://127.0.0.1:19225/collection1/, StdNode: http://127.0.0.1:31182/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 27272 T2095 C115 P19225 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27272 T2062 C116 P53059 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27275 T2095 C115 P19225 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@431ca8ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@31417dd9),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@431ca8ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@31417dd9),segFN=segments_3,generation=3,filenames=[_0.fnm, _0.dvd, _0.nvm, _0.dvm, _0.pos, _0.nvd, _0.tim, _0.fdx, _0.si, _0.tip, _0.doc, segments_3, _0.fdt]
[junit4:junit4] 2> 27276 T2095 C115 P19225 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fnm, _0.dvd, _0.nvm, _0.dvm, _0.pos, _0.nvd, _0.tim, _0.fdx, _0.si, _0.tip, _0.doc, segments_3, _0.fdt]
[junit4:junit4] 2> 27276 T2062 C116 P53059 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1c5fdc11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@780b7ed7),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1c5fdc11 lockFactory=org.apache.lucene.store.NativeFSLockFactory@780b7ed7),segFN=segments_3,generation=3,filenames=[_0.fnm, _0.dvd, _0.nvm, _0.dvm, _0.pos, _0.nvd, _0.tim, _0.fdx, _0.si, _0.tip, _0.doc, segments_3, _0.fdt]
[junit4:junit4] 2> 27276 T2062 C116 P53059 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fnm, _0.dvd, _0.nvm, _0.dvm, _0.pos, _0.nvd, _0.tim, _0.fdx, _0.si, _0.tip, _0.doc, segments_3, _0.fdt]
[junit4:junit4] 2> 27277 T2095 C115 P19225 oass.SolrIndexSearcher.<init> Opening Searcher@3ee530a6 main
[junit4:junit4] 2> C117_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:31182_, base_url=http://127.0.0.1:31182}
[junit4:junit4] 2> 27277 T2111 C117 P31182 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27277 T2062 C116 P53059 oass.SolrIndexSearcher.<init> Opening Searcher@325e9cd main
[junit4:junit4] 2> 27277 T2095 C115 P19225 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27278 T2111 C117 P31182 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6c155fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b088353),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6c155fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@4b088353),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 27278 T2106 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ee530a6 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 27278 T2062 C116 P53059 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27278 T2074 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@325e9cd main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 27279 T2111 C117 P31182 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 27279 T2095 C115 P19225 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 27279 T2062 C116 P53059 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 27279 T2111 C117 P31182 oass.SolrIndexSearcher.<init> Opening Searcher@169347e0 main
[junit4:junit4] 2> 27280 T2111 C117 P31182 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27280 T2123 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@169347e0 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 27281 T2111 C117 P31182 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 27281 T2084 C118 P43851 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 15
[junit4:junit4] 2> 27281 T2030 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 27282 T2030 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27283 T2030 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 27285 T2042 C120 P53055 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 27286 T2030 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53052/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1f53ceb4
[junit4:junit4] 2> 27287 T2030 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 27287 T2136 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53052. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 27287 T2136 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53052, initiating session
[junit4:junit4] 2> 27287 T2032 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:31252
[junit4:junit4] 2> 27288 T2032 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:31252
[junit4:junit4] 2> 27289 T2034 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6b4a2f4c000d with negotiated timeout 10000 for client /140.211.11.196:31252
[junit4:junit4] 2> 27289 T2136 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53052, sessionid = 0x13d6b4a2f4c000d, negotiated timeout = 10000
[junit4:junit4] 2> 27289 T2137 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f53ceb4 name:ZooKeeperConnection Watcher:127.0.0.1:53052/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 27289 T2030 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 27290 T2030 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 27292 T2035 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6b4a2f4c000d
[junit4:junit4] 2> 27293 T2137 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 27293 T2032 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:31252 which had sessionid 0x13d6b4a2f4c000d
[junit4:junit4] 2> 27293 T2030 oaz.ZooKeeper.close Session: 0x13d6b4a2f4c000d closed
[junit4:junit4] 2> 27294 T2064 C116 P53059 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 27296 T2078 C118 P43851 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 27297 T2096 C115 P19225 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 27301 T2140 C116 P53059 REQ /select {NOW=1363304684001&shard.url=127.0.0.1:53059/collection1/|127.0.0.1:19225/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=1 status=0 QTime=0
[junit4:junit4] 2> 27301 T2113 C117 P31182 REQ /select {NOW=1363304684001&shard.url=127.0.0.1:43851/collection1/|127.0.0.1:31182/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=0 status=0 QTime=0
[junit4:junit4] 2> 27304 T2140 C116 P53059 REQ /select {NOW=1363304684001&shard.url=127.0.0.1:53059/collection1/|127.0.0.1:19225/collection1/&ids=1&q=*:*&distrib=false&wt=javabin&isShard=true&version=2} status=0 QTime=0
[junit4:junit4] 2> 27305 T2112 C117 P31182 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=6
[junit4:junit4] 2> 27309 T2042 C120 P53055 /update {wt=javabin&version=2} {add=[2 (1429528572339421184)]} 0 2
[junit4:junit4] 2> 27318 T2111 C117 P31182 /update {distrib.from=http://127.0.0.1:43851/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429528572344664064)]} 0 2
[junit4:junit4] 2> 27318 T2084 C118 P43851 /update {wt=javabin&version=2} {add=[2 (1429528572344664064)]} 0 6
[junit4:junit4] 2> 27322 T2042 C120 P53055 /update {wt=javabin&version=2} {add=[3 (1429528572354101248)]} 0 1
[junit4:junit4] 2> 27331 T2111 C117 P31182 /update {distrib.from=http://127.0.0.1:43851/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1429528572359344128)]} 0 1
[junit4:junit4] 2> 27331 T2080 C118 P43851 /update {distrib.from=http://127.0.0.1:53059/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1429528572359344128)]} 0 5
[junit4:junit4] 2> 27332 T2068 C116 P53059 /update {wt=javabin&version=2} {add=[3]} 0 7
[junit4:junit4] 2> 27336 T2042 C120 P53055 /update {wt=javabin&version=2} {add=[4 (1429528572368781312)]} 0 1
[junit4:junit4] 2> 27348 T2094 C115 P19225 /update {distrib.from=http://127.0.0.1:53059/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1429528572375072768)]} 0 2
[junit4:junit4] 2> 27349 T2062 C116 P53059 /update {distrib.from=http://127.0.0.1:43851/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1429528572375072768)]} 0 8
[junit4:junit4] 2> 27349 T2084 C118 P43851 /update {wt=javabin&version=2} {add=[4]} 0 10
[junit4:junit4] 2> 27353 T2042 C120 P53055 /update {wt=javabin&version=2} {add=[5 (1429528572386607104)]} 0 1
[junit4:junit4] 2> 27360 T2111 C117 P31182 /update {distrib.from=http://127.0.0.1:43851/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1429528572390801408)]} 0 1
[junit4:junit4] 2> 27361 T2084 C118 P43851 /update {wt=javabin&version=2} {add=[5 (1429528572390801408)]} 0 5
[junit4:junit4] 2> 27366 T2042 C120 P53055 /update {wt=javabin&version=2} {add=[6 (1429528572399190016)]} 0 2
[junit4:junit4] 2> 27376 T2111 C117 P31182 /update {distrib.from=http://127.0.0.1:43851/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1429528572406530048)]} 0 1
[junit4:junit4] 2> 27377 T2080 C118 P43851 /update {distrib.from=http://127.0.0.1:53059/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1429528572406530048)]} 0 6
[junit4:junit4] 2> 27377 T2068 C116 P53059 /update {wt=javabin&version=2} {add=[6]} 0 8
[junit4:junit4] 2> 27382 T2042 C120 P53055 /update {wt=javabin&version=2} {add=[7 (1429528572415967232)]} 0 2
[junit4:junit4] 2> 27394 T2111 C117 P31182 /update {distrib.from=http://127.0.0.1:43851/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1429528572424355840)]} 0 2
[junit4:junit4] 2> 27395 T2080 C118 P43851 /update {distrib.from=http://127.0.0.1:53059/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1429528572424355840)]} 0 7
[junit4:junit4] 2> 27396 T2068 C116 P53059 /update {wt=javabin&version=2} {add=[7]} 0 11
[junit4:junit4] 2> 27400 T2042 C120 P5
[...truncated too long message...]
per (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=5949ACF497AB2B3F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=bg -Dtests.timezone=Pacific/Ponape -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 139s J0 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.common.SolrException: No registered leader was found, collection:collection1 slice:shard1
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([5949ACF497AB2B3F:D8AF22ECE0F44B03]:0)
[junit4:junit4] > at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:484)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:291)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:116)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2> 139045 T2030 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 139051 T2029 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4:junit4] 2> 139299 T2033 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> 140061 T2121 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 140061 T2121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 140061 T2121 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 140061 T2121 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=bg, timezone=Pacific/Ponape
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=1,free=333712880,total=478281728
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestLRUCache, SystemInfoHandlerTest, PreAnalyzedFieldTest, TestReversedWildcardFilterFactory, TestStressRecovery, OverseerCollectionProcessorTest, SpatialFilterTest, AutoCommitTest, DocValuesTest, TestFunctionQuery, TestDocSet, TestTrie, TestPluginEnable, AnalysisAfterCoreReloadTest, TestJoin, CSVRequestHandlerTest, TestDynamicFieldResource, ZkCLITest, TermsComponentTest, UnloadDistributedZkTest, BadComponentTest, TestFastLRUCache, TestGroupingSearch, TestPHPSerializedResponseWriter, SearchHandlerTest, DirectSolrConnectionTest, TestCoreContainer, CacheHeaderTest, TestRandomDVFaceting, CoreAdminHandlerTest, BasicDistributedZkTest, TestSolrIndexConfig, ZkControllerTest, SchemaVersionSpecificBehaviorTest, TestWriterPerf, DistributedTermsComponentTest, AliasIntegrationTest, TestSort, TestSearchPerf, TestQueryUtils, TestBadConfig, LoggingHandlerTest, TestLFUCache, CircularListTest, DateFieldTest, FileBasedSpellCheckerTest, ResourceLoaderTest, ShardRoutingTest, DistributedQueryElevationComponentTest, CachingDirectoryFactoryTest, RegexBoostProcessorTest, TestPerFieldSimilarity, TestSolrDeletionPolicy2, TestIBSimilarityFactory, UUIDFieldTest, SoftAutoCommitTest, TestDocumentBuilder, SuggesterFSTTest, ShowFileRequestHandlerTest, TestSurroundQueryParser, TestSweetSpotSimilarityFactory, UpdateRequestProcessorFactoryTest, TestCopyFieldCollectionResource, SliceStateUpdateTest, SolrIndexSplitterTest, FieldMutatingUpdateProcessorTest, TestRemoteStreaming, BasicDistributedZk2Test]
[junit4:junit4] Completed on J0 in 140.33s, 1 test, 1 error <<< FAILURES!
[...truncated 423 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/lucene/common-build.xml:877: There were test failures: 272 suites, 1144 tests, 1 error, 27 ignored (8 assumptions)
Total time: 52 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java6 - Build # 16007 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java6/16007/
All tests passed
Build Log:
[...truncated 7920 lines...]
[javac] Compiling 538 source files to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/classes/java
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:57: not a statement
[javac] Package package = SolrCore.class.getPackage();
[javac] ^
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:57: ';' expected
[javac] Package package = SolrCore.class.getPackage();
[javac] ^
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:67: illegal start of expression
[javac] StringEscapeUtils.escapeJavaScript(package.getSpecificationVersion())
[javac] ^
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:67: '}' expected
[javac] StringEscapeUtils.escapeJavaScript(package.getSpecificationVersion())
[javac] ^
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:51: 'try' without 'catch' or 'finally'
[javac] try {
[javac] ^
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:72: 'finally' without 'try'
[javac] } finally {
[javac] ^
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:75: illegal start of type
[javac] } else {
[javac] ^
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:75: ';' expected
[javac] } else {
[javac] ^
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:76: <identifier> expected
[javac] response.sendError(404);
[javac] ^
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:76: illegal start of type
[javac] response.sendError(404);
[javac] ^
[javac] /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/core/src/java/org/apache/solr/servlet/LoadAdminUiServlet.java:78: class, interface, or enum expected
[javac] }
[javac] ^
[javac] 11 errors
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/common-build.xml:389: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/common-build.xml:335: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/lucene/common-build.xml:479: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/lucene/common-build.xml:1578: Compile failed; see the compiler error output for details.
Total time: 27 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java6 - Build # 16006 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java6/16006/
1 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:22357/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:38389/collection1], CloudJettyRunner [url=http://127.0.0.1:38389/collection1]]
Stack Trace:
java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:22357/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:38389/collection1], CloudJettyRunner [url=http://127.0.0.1:38389/collection1]]
at __randomizedtesting.SeedInfo.seed([A1E6A0DE354761F0:20002EC6421801CC]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 8519 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 0 T999 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 5 T999 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1363354612464
[junit4:junit4] 2> 6 T999 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 6 T1000 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 9 T1000 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 10 T1000 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 10 T1000 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 10 T1000 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 11 T1000 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1363354612463/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 107 T999 oasc.ZkTestServer.run start zk server on port:22341
[junit4:junit4] 2> 107 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@46a3b95a
[junit4:junit4] 2> 108 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 109 T1005 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 109 T1005 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 110 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22342
[junit4:junit4] 2> 111 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22342
[junit4:junit4] 2> 111 T1003 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 113 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f60000 with negotiated timeout 10000 for client /140.211.11.196:22342
[junit4:junit4] 2> 113 T1005 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f60000, negotiated timeout = 10000
[junit4:junit4] 2> 114 T1006 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46a3b95a name:ZooKeeperConnection Watcher:127.0.0.1:22341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 114 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 115 T999 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 118 T1004 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6e4472f60000
[junit4:junit4] 2> 126 T1006 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 127 T1001 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:22342 which had sessionid 0x13d6e4472f60000
[junit4:junit4] 2> 126 T999 oaz.ZooKeeper.close Session: 0x13d6e4472f60000 closed
[junit4:junit4] 2> 128 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3f003e7f
[junit4:junit4] 2> 129 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 129 T1007 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 129 T1007 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 130 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22343
[junit4:junit4] 2> 130 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22343
[junit4:junit4] 2> 131 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f60001 with negotiated timeout 10000 for client /140.211.11.196:22343
[junit4:junit4] 2> 131 T1007 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f60001, negotiated timeout = 10000
[junit4:junit4] 2> 132 T1008 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f003e7f name:ZooKeeperConnection Watcher:127.0.0.1:22341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 132 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 132 T999 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 137 T999 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 141 T999 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 143 T999 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 153 T999 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 154 T999 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 167 T999 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 168 T999 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 273 T999 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 273 T999 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 276 T999 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 277 T999 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 285 T999 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 286 T999 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 289 T999 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 290 T999 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 293 T999 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 293 T999 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 296 T999 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 297 T999 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 300 T999 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 301 T999 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 304 T1004 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6e4472f60001
[junit4:junit4] 2> 311 T1008 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 311 T1001 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:22343 which had sessionid 0x13d6e4472f60001
[junit4:junit4] 2> 311 T999 oaz.ZooKeeper.close Session: 0x13d6e4472f60001 closed
[junit4:junit4] 2> 505 T999 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 509 T999 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22346
[junit4:junit4] 2> 510 T999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 510 T999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 511 T999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363354612770
[junit4:junit4] 2> 511 T999 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363354612770/solr.xml
[junit4:junit4] 2> 512 T999 oasc.CoreContainer.<init> New CoreContainer 1230774714
[junit4:junit4] 2> 512 T999 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363354612770/'
[junit4:junit4] 2> 513 T999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363354612770/'
[junit4:junit4] 2> 562 T999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 563 T999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 563 T999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 564 T999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 564 T999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 565 T999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 565 T999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 566 T999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 566 T999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 566 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 589 T999 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 607 T999 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:22341/solr
[junit4:junit4] 2> 608 T999 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 608 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a823021
[junit4:junit4] 2> 609 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 610 T1018 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 611 T1018 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 611 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22347
[junit4:junit4] 2> 611 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22347
[junit4:junit4] 2> 613 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f60002 with negotiated timeout 20000 for client /140.211.11.196:22347
[junit4:junit4] 2> 613 T1018 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f60002, negotiated timeout = 20000
[junit4:junit4] 2> 613 T1019 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a823021 name:ZooKeeperConnection Watcher:127.0.0.1:22341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 614 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 615 T1004 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6e4472f60002
[junit4:junit4] 2> 623 T1019 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 623 T1001 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:22347 which had sessionid 0x13d6e4472f60002
[junit4:junit4] 2> 623 T999 oaz.ZooKeeper.close Session: 0x13d6e4472f60002 closed
[junit4:junit4] 2> 624 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 637 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@39312903
[junit4:junit4] 2> 638 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 638 T1020 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 639 T1020 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 639 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22348
[junit4:junit4] 2> 639 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22348
[junit4:junit4] 2> 641 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f60003 with negotiated timeout 20000 for client /140.211.11.196:22348
[junit4:junit4] 2> 641 T1020 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f60003, negotiated timeout = 20000
[junit4:junit4] 2> 641 T1021 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39312903 name:ZooKeeperConnection Watcher:127.0.0.1:22341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 641 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 648 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 649 T999 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 652 T999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22346_
[junit4:junit4] 2> 653 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:22346_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:22346_
[junit4:junit4] 2> 659 T999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22346_
[junit4:junit4] 2> 662 T999 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 675 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 676 T999 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 685 T999 oasc.Overseer.start Overseer (id=89348807882833923-127.0.0.1:22346_-n_0000000000) starting
[junit4:junit4] 2> 686 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 687 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 688 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 698 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 700 T1023 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 700 T999 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 712 T999 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 714 T999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 720 T1022 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 720 T1024 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363354612770/collection1
[junit4:junit4] 2> 721 T1024 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 721 T1024 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 721 T1024 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 723 T1024 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363354612770/collection1/'
[junit4:junit4] 2> 724 T1024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363354612770/collection1/lib/README' to classloader
[junit4:junit4] 2> 724 T1024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363354612770/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 772 T1024 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 827 T1024 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 928 T1024 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 935 T1024 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1549 T1024 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1560 T1024 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1564 T1024 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1576 T1024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1580 T1024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1583 T1024 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1584 T1024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1585 T1024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1585 T1024 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1586 T1024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1586 T1024 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1586 T1024 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1586 T1024 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363354612770/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363354612463/control/data/
[junit4:junit4] 2> 1586 T1024 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6477eb97
[junit4:junit4] 2> 1587 T1024 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1587 T1024 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/control/data forceNew: false
[junit4:junit4] 2> 1587 T1024 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363354612463/control/data/index/
[junit4:junit4] 2> 1587 T1024 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363354612463/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1588 T1024 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/control/data/index forceNew: false
[junit4:junit4] 2> 1590 T1024 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13f40fb4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@776977a4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1591 T1024 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1592 T1024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1593 T1024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1593 T1024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1593 T1024 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1594 T1024 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1594 T1024 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1594 T1024 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1594 T1024 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1594 T1024 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1600 T1024 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1605 T1024 oass.SolrIndexSearcher.<init> Opening Searcher@2ef0c2dc main
[junit4:junit4] 2> 1606 T1024 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363354612463/control/data/tlog
[junit4:junit4] 2> 1606 T1024 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1606 T1024 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1609 T1025 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2ef0c2dc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1610 T1024 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1610 T1024 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1610 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2223 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2224 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:22346_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22346"}
[junit4:junit4] 2> 2224 T1022 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2224 T1022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2224 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2239 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2624 T1024 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2624 T1024 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22346 collection:control_collection shard:shard1
[junit4:junit4] 2> 2624 T1024 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2640 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2641 T1024 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2641 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2643 T1024 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2643 T1024 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2643 T1024 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22346/collection1/
[junit4:junit4] 2> 2644 T1024 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2644 T1024 oasc.SyncStrategy.syncToMe http://127.0.0.1:22346/collection1/ has no replicas
[junit4:junit4] 2> 2644 T1024 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22346/collection1/
[junit4:junit4] 2> 2644 T1024 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2647 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3743 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3764 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3822 T1024 oasc.ZkController.register We are http://127.0.0.1:22346/collection1/ and leader is http://127.0.0.1:22346/collection1/
[junit4:junit4] 2> 3822 T1024 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22346
[junit4:junit4] 2> 3822 T1024 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3822 T1024 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3822 T1024 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3824 T1024 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3825 T999 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3826 T999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3826 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3842 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3843 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@26460762
[junit4:junit4] 2> 3844 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3844 T1027 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 3845 T1027 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 3845 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22351
[junit4:junit4] 2> 3845 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22351
[junit4:junit4] 2> 3847 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f60004 with negotiated timeout 10000 for client /140.211.11.196:22351
[junit4:junit4] 2> 3847 T1027 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f60004, negotiated timeout = 10000
[junit4:junit4] 2> 3847 T1028 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26460762 name:ZooKeeperConnection Watcher:127.0.0.1:22341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3847 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3849 T999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3851 T999 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4035 T999 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4038 T999 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22352
[junit4:junit4] 2> 4038 T999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4039 T999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4039 T999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363354616310
[junit4:junit4] 2> 4040 T999 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363354616310/solr.xml
[junit4:junit4] 2> 4040 T999 oasc.CoreContainer.<init> New CoreContainer 885495503
[junit4:junit4] 2> 4041 T999 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363354616310/'
[junit4:junit4] 2> 4041 T999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363354616310/'
[junit4:junit4] 2> 4090 T999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4090 T999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4091 T999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4091 T999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4092 T999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4092 T999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4093 T999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4093 T999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4094 T999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4094 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4115 T999 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4133 T999 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:22341/solr
[junit4:junit4] 2> 4134 T999 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4134 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@700b27b6
[junit4:junit4] 2> 4135 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4136 T1038 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4136 T1038 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 4137 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22353
[junit4:junit4] 2> 4137 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22353
[junit4:junit4] 2> 4139 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f60005 with negotiated timeout 20000 for client /140.211.11.196:22353
[junit4:junit4] 2> 4139 T1038 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f60005, negotiated timeout = 20000
[junit4:junit4] 2> 4139 T1039 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@700b27b6 name:ZooKeeperConnection Watcher:127.0.0.1:22341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4139 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4141 T1004 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6e4472f60005
[junit4:junit4] 2> 4148 T1039 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4148 T1001 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:22353 which had sessionid 0x13d6e4472f60005
[junit4:junit4] 2> 4148 T999 oaz.ZooKeeper.close Session: 0x13d6e4472f60005 closed
[junit4:junit4] 2> 4149 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4160 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@335d5786
[junit4:junit4] 2> 4161 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4161 T1040 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4162 T1040 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 4162 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22354
[junit4:junit4] 2> 4162 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22354
[junit4:junit4] 2> 4163 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f60006 with negotiated timeout 20000 for client /140.211.11.196:22354
[junit4:junit4] 2> 4163 T1040 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f60006, negotiated timeout = 20000
[junit4:junit4] 2> 4164 T1041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@335d5786 name:ZooKeeperConnection Watcher:127.0.0.1:22341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4164 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4165 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4166 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4169 T999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5172 T999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22352_
[junit4:junit4] 2> 5173 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:22352_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:22352_
[junit4:junit4] 2> 5200 T999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22352_
[junit4:junit4] 2> 5204 T1021 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5204 T1028 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5204 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5204 T1041 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5211 T1042 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363354616310/collection1
[junit4:junit4] 2> 5212 T1042 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5212 T1042 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5213 T1042 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5214 T1042 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363354616310/collection1/'
[junit4:junit4] 2> 5216 T1042 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363354616310/collection1/lib/README' to classloader
[junit4:junit4] 2> 5216 T1042 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363354616310/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5276 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5276 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22346__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:22346_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22346"}
[junit4:junit4] 2> 5277 T1042 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5290 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5290 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5290 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5336 T1042 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5437 T1042 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5443 T1042 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6045 T1042 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6058 T1042 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6062 T1042 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6077 T1042 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6083 T1042 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6088 T1042 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6089 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6090 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6090 T1042 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6091 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6091 T1042 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6091 T1042 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6092 T1042 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363354616310/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty1/
[junit4:junit4] 2> 6092 T1042 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6477eb97
[junit4:junit4] 2> 6093 T1042 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6093 T1042 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty1 forceNew: false
[junit4:junit4] 2> 6093 T1042 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty1/index/
[junit4:junit4] 2> 6094 T1042 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6094 T1042 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty1/index forceNew: false
[junit4:junit4] 2> 6097 T1042 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6097 T1042 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6100 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6100 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6100 T1042 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6101 T1042 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6102 T1042 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6102 T1042 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6102 T1042 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6103 T1042 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6103 T1042 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6110 T1042 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6116 T1042 oass.SolrIndexSearcher.<init> Opening Searcher@23fc80f1 main
[junit4:junit4] 2> 6116 T1042 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty1/tlog
[junit4:junit4] 2> 6117 T1042 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6117 T1042 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6122 T1043 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23fc80f1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6123 T1042 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6124 T1042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6795 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6795 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:22352_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22352"}
[junit4:junit4] 2> 6796 T1022 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 6796 T1022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6811 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6811 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6811 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7126 T1042 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7126 T1042 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22352 collection:collection1 shard:shard1
[junit4:junit4] 2> 7127 T1042 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7145 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7146 T1042 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7146 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7148 T1042 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7149 T1042 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7149 T1042 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22352/collection1/
[junit4:junit4] 2> 7149 T1042 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7149 T1042 oasc.SyncStrategy.syncToMe http://127.0.0.1:22352/collection1/ has no replicas
[junit4:junit4] 2> 7149 T1042 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22352/collection1/
[junit4:junit4] 2> 7150 T1042 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7153 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8316 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8332 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8332 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8332 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8379 T1042 oasc.ZkController.register We are http://127.0.0.1:22352/collection1/ and leader is http://127.0.0.1:22352/collection1/
[junit4:junit4] 2> 8379 T1042 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22352
[junit4:junit4] 2> 8379 T1042 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8379 T1042 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8380 T1042 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8381 T1042 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8382 T999 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 8383 T999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8383 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8589 T999 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8592 T999 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22357
[junit4:junit4] 2> 8593 T999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8593 T999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8594 T999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363354620856
[junit4:junit4] 2> 8594 T999 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363354620856/solr.xml
[junit4:junit4] 2> 8595 T999 oasc.CoreContainer.<init> New CoreContainer 218433027
[junit4:junit4] 2> 8595 T999 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363354620856/'
[junit4:junit4] 2> 8596 T999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363354620856/'
[junit4:junit4] 2> 8644 T999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8645 T999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8645 T999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8646 T999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8646 T999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8647 T999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8647 T999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8647 T999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8648 T999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8648 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8668 T999 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8686 T999 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:22341/solr
[junit4:junit4] 2> 8687 T999 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8687 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d4fc1f8
[junit4:junit4] 2> 8688 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8689 T1054 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8689 T1054 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 8690 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22358
[junit4:junit4] 2> 8690 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22358
[junit4:junit4] 2> 8691 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f60007 with negotiated timeout 20000 for client /140.211.11.196:22358
[junit4:junit4] 2> 8691 T1054 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f60007, negotiated timeout = 20000
[junit4:junit4] 2> 8692 T1055 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d4fc1f8 name:ZooKeeperConnection Watcher:127.0.0.1:22341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8692 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8694 T1004 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6e4472f60007
[junit4:junit4] 2> 8695 T1055 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8695 T1001 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:22358 which had sessionid 0x13d6e4472f60007
[junit4:junit4] 2> 8695 T999 oaz.ZooKeeper.close Session: 0x13d6e4472f60007 closed
[junit4:junit4] 2> 8695 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8706 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@604b1a70
[junit4:junit4] 2> 8708 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8708 T1056 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8709 T1056 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 8709 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22359
[junit4:junit4] 2> 8709 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22359
[junit4:junit4] 2> 8710 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f60008 with negotiated timeout 20000 for client /140.211.11.196:22359
[junit4:junit4] 2> 8710 T1056 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f60008, negotiated timeout = 20000
[junit4:junit4] 2> 8711 T1057 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@604b1a70 name:ZooKeeperConnection Watcher:127.0.0.1:22341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8711 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8712 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8713 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8715 T999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9718 T999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22357_
[junit4:junit4] 2> 9719 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f60008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:22357_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:22357_
[junit4:junit4] 2> 9720 T999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22357_
[junit4:junit4] 2> 9727 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9728 T1021 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9728 T1028 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9729 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9729 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9728 T1057 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9730 T1041 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9736 T1058 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363354620856/collection1
[junit4:junit4] 2> 9736 T1058 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9737 T1058 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9737 T1058 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9738 T1058 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363354620856/collection1/'
[junit4:junit4] 2> 9739 T1058 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363354620856/collection1/lib/README' to classloader
[junit4:junit4] 2> 9740 T1058 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363354620856/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9786 T1058 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 9838 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9839 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22352__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:22352_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22352"}
[junit4:junit4] 2> 9846 T1058 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9852 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9852 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9852 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9852 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9853 T1058 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9859 T1058 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10464 T1058 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10476 T1058 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10480 T1058 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10495 T1058 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10500 T1058 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10504 T1058 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10505 T1058 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10506 T1058 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10506 T1058 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10507 T1058 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10507 T1058 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10508 T1058 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 10508 T1058 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363354620856/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty2/
[junit4:junit4] 2> 10508 T1058 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6477eb97
[junit4:junit4] 2> 10509 T1058 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 10509 T1058 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty2 forceNew: false
[junit4:junit4] 2> 10509 T1058 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty2/index/
[junit4:junit4] 2> 10510 T1058 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10510 T1058 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty2/index forceNew: false
[junit4:junit4] 2> 10513 T1058 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16340bd8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b29c110),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10513 T1058 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10516 T1058 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10516 T1058 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10516 T1058 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10517 T1058 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10518 T1058 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10518 T1058 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10518 T1058 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10519 T1058 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10519 T1058 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10526 T1058 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10532 T1058 oass.SolrIndexSearcher.<init> Opening Searcher@17f70082 main
[junit4:junit4] 2> 10532 T1058 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty2/tlog
[junit4:junit4] 2> 10533 T1058 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10533 T1058 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10537 T1059 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17f70082 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10538 T1058 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10539 T1058 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11578 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11579 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:22357_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22357"}
[junit4:junit4] 2> 11579 T1022 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 11580 T1022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11601 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11601 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11601 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11601 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12542 T1058 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 12542 T1058 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22357 collection:collection1 shard:shard1
[junit4:junit4] 2> 12545 T1058 oasc.ZkController.register We are http://127.0.0.1:22357/collection1/ and leader is http://127.0.0.1:22352/collection1/
[junit4:junit4] 2> 12546 T1058 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22357
[junit4:junit4] 2> 12546 T1058 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 12546 T1058 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C68 name=collection1 org.apache.solr.core.SolrCore@47426a2d url=http://127.0.0.1:22357/collection1 node=127.0.0.1:22357_ C68_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:22357_, base_url=http://127.0.0.1:22357}
[junit4:junit4] 2> 12547 T1060 C68 P22357 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 12547 T1060 C68 P22357 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 12547 T1058 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12548 T1060 C68 P22357 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 12548 T1060 C68 P22357 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 12549 T999 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 12549 T1060 C68 P22357 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12550 T999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 12550 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12756 T999 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12759 T999 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22364
[junit4:junit4] 2> 12760 T999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12760 T999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12761 T999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363354625024
[junit4:junit4] 2> 12761 T999 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363354625024/solr.xml
[junit4:junit4] 2> 12762 T999 oasc.CoreContainer.<init> New CoreContainer 949545703
[junit4:junit4] 2> 12762 T999 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363354625024/'
[junit4:junit4] 2> 12763 T999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363354625024/'
[junit4:junit4] 2> 12811 T999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12812 T999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12813 T999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12813 T999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12813 T999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12814 T999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12814 T999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12815 T999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12815 T999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12816 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12835 T999 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12853 T999 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:22341/solr
[junit4:junit4] 2> 12854 T999 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12854 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@41b9508c
[junit4:junit4] 2> 12855 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12856 T1071 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 12856 T1071 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 12857 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22366
[junit4:junit4] 2> 12857 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22366
[junit4:junit4] 2> 12858 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f60009 with negotiated timeout 20000 for client /140.211.11.196:22366
[junit4:junit4] 2> 12859 T1071 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f60009, negotiated timeout = 20000
[junit4:junit4] 2> 12859 T1072 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41b9508c name:ZooKeeperConnection Watcher:127.0.0.1:22341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12859 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12860 T1004 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6e4472f60009
[junit4:junit4] 2> 12862 T1072 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12862 T1001 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:22366 which had sessionid 0x13d6e4472f60009
[junit4:junit4] 2> 12862 T999 oaz.ZooKeeper.close Session: 0x13d6e4472f60009 closed
[junit4:junit4] 2> 12863 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12873 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7f5be684
[junit4:junit4] 2> 12874 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12874 T1073 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 12875 T1073 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 12875 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22367
[junit4:junit4] 2> 12875 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22367
[junit4:junit4] 2> 12876 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f6000a with negotiated timeout 20000 for client /140.211.11.196:22367
[junit4:junit4] 2> 12876 T1073 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f6000a, negotiated timeout = 20000
[junit4:junit4] 2> 12877 T1074 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f5be684 name:ZooKeeperConnection Watcher:127.0.0.1:22341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12877 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12878 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f6000a type:create cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12879 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f6000a type:create cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12888 T999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13111 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13112 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22357__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:22357_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22357"}
[junit4:junit4] 2> 13117 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13117 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13117 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13117 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13117 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13568 T1031 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:22357__collection1&state=recovering&nodeName=127.0.0.1:22357_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 13891 T999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22364_
[junit4:junit4] 2> 13893 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f6000a type:delete cxid:0xd zxid:0x87 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:22364_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:22364_
[junit4:junit4] 2> 13894 T999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22364_
[junit4:junit4] 2> 13896 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13897 T1028 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13897 T1021 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13897 T1074 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13897 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13897 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13897 T1057 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13897 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13898 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13898 T1041 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13906 T1075 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363354625024/collection1
[junit4:junit4] 2> 13906 T1075 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13907 T1075 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13907 T1075 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13908 T1075 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363354625024/collection1/'
[junit4:junit4] 2> 13909 T1075 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363354625024/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13910 T1075 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363354625024/collection1/lib/README' to classloader
[junit4:junit4] 2> 13958 T1075 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14019 T1075 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14120 T1075 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14126 T1075 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 14799 T1075 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14812 T1075 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14816 T1075 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14831 T1075 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14836 T1075 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14840 T1075 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14841 T1075 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14842 T1075 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14842 T1075 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14843 T1075 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14843 T1075 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14843 T1075 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14844 T1075 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363354625024/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty3/
[junit4:junit4] 2> 14844 T1075 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6477eb97
[junit4:junit4] 2> 14844 T1075 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 14845 T1075 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty3 forceNew: false
[junit4:junit4] 2> 14845 T1075 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty3/index/
[junit4:junit4] 2> 14845 T1075 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14846 T1075 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty3/index forceNew: false
[junit4:junit4] 2> 14848 T1075 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a459854 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19b41a92),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14849 T1075 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14851 T1075 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14851 T1075 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14852 T1075 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14853 T1075 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14853 T1075 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14853 T1075 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14854 T1075 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14854 T1075 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14855 T1075 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14862 T1075 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14867 T1075 oass.SolrIndexSearcher.<init> Opening Searcher@5ced448f main
[junit4:junit4] 2> 14868 T1075 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty3/tlog
[junit4:junit4] 2> 14868 T1075 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14869 T1075 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14873 T1076 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5ced448f main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14874 T1075 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14874 T1075 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> C68_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:22357_, base_url=http://127.0.0.1:22357}
[junit4:junit4] 2> 15569 T1060 C68 P22357 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:22352/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 15569 T1060 C68 P22357 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22357 START replicas=[http://127.0.0.1:22352/collection1/] nUpdates=100
[junit4:junit4] 2> 15569 T1060 C68 P22357 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 15570 T1060 C68 P22357 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 15570 T1060 C68 P22357 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 15570 T1060 C68 P22357 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 15571 T1060 C68 P22357 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 15571 T1060 C68 P22357 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:22352/collection1/. core=collection1
[junit4:junit4] 2> 15571 T1060 C68 P22357 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C69 name=collection1 org.apache.solr.core.SolrCore@31fc1e62 url=http://127.0.0.1:22352/collection1 node=127.0.0.1:22352_ C69_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22352_, base_url=http://127.0.0.1:22352, leader=true}
[junit4:junit4] 2> 15577 T1032 C69 P22352 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 15587 T1033 C69 P22352 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 15589 T1033 C69 P22352 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15590 T1033 C69 P22352 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15590 T1033 C69 P22352 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15591 T1033 C69 P22352 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15591 T1033 C69 P22352 oass.SolrIndexSearcher.<init> Opening Searcher@153ac7ad realtime
[junit4:junit4] 2> 15591 T1033 C69 P22352 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15592 T1033 C69 P22352 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 15592 T1060 C68 P22357 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15593 T1060 C68 P22357 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 15594 T1034 C69 P22352 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15594 T1034 C69 P22352 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 15595 T1060 C68 P22357 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 15595 T1060 C68 P22357 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 15595 T1060 C68 P22357 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 15597 T1034 C69 P22352 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 15598 T1060 C68 P22357 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 15599 T1060 C68 P22357 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty2/index.20130315063708056 forceNew: false
[junit4:junit4] 2> 15599 T1060 C68 P22357 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@42a94fe0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b81ad9f) fullCopy=false
[junit4:junit4] 2> 15602 T1034 C69 P22352 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 15603 T1060 C68 P22357 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 15604 T1060 C68 P22357 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 15604 T1060 C68 P22357 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 15605 T1060 C68 P22357 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16340bd8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b29c110),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16340bd8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b29c110),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15606 T1060 C68 P22357 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15606 T1060 C68 P22357 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 15606 T1060 C68 P22357 oass.SolrIndexSearcher.<init> Opening Searcher@16cdc6e3 main
[junit4:junit4] 2> 15607 T1059 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16cdc6e3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 15608 T1060 C68 P22357 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@42a94fe0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b81ad9f)
[junit4:junit4] 2> 15608 T1060 C68 P22357 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 15608 T1060 C68 P22357 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 15608 T1060 C68 P22357 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 15609 T1060 C68 P22357 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15610 T1060 C68 P22357 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 16125 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16125 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:22364_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22364"}
[junit4:junit4] 2> 16126 T1022 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 16126 T1022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16133 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22357__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:22357_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22357"}
[junit4:junit4] 2> 16203 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16203 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16203 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16203 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16203 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16878 T1075 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16878 T1075 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22364 collection:collection1 shard:shard1
[junit4:junit4] 2> 16881 T1075 oasc.ZkController.register We are http://127.0.0.1:22364/collection1/ and leader is http://127.0.0.1:22352/collection1/
[junit4:junit4] 2> 16882 T1075 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22364
[junit4:junit4] 2> 16882 T1075 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16882 T1075 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C70 name=collection1 org.apache.solr.core.SolrCore@1c21fd6d url=http://127.0.0.1:22364/collection1 node=127.0.0.1:22364_ C70_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:22364_, base_url=http://127.0.0.1:22364}
[junit4:junit4] 2> 16882 T1079 C70 P22364 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16883 T1075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16884 T1079 C70 P22364 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16884 T1079 C70 P22364 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16884 T1079 C70 P22364 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16885 T999 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 16885 T999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16886 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16927 T1079 C70 P22364 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17082 T999 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 17085 T999 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:38389
[junit4:junit4] 2> 17086 T999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 17087 T999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 17087 T999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363354629356
[junit4:junit4] 2> 17088 T999 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363354629356/solr.xml
[junit4:junit4] 2> 17088 T999 oasc.CoreContainer.<init> New CoreContainer 2074077083
[junit4:junit4] 2> 17089 T999 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363354629356/'
[junit4:junit4] 2> 17089 T999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363354629356/'
[junit4:junit4] 2> 17138 T999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 17138 T999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 17139 T999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 17139 T999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 17140 T999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 17140 T999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 17140 T999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 17141 T999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 17141 T999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 17142 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 17163 T999 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 17181 T999 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:22341/solr
[junit4:junit4] 2> 17182 T999 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 17182 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@77d70c22
[junit4:junit4] 2> 17183 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17184 T1090 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 17184 T1090 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 17185 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:20200
[junit4:junit4] 2> 17185 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:20200
[junit4:junit4] 2> 17187 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f6000b with negotiated timeout 20000 for client /140.211.11.196:20200
[junit4:junit4] 2> 17187 T1090 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f6000b, negotiated timeout = 20000
[junit4:junit4] 2> 17187 T1091 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77d70c22 name:ZooKeeperConnection Watcher:127.0.0.1:22341 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17187 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17189 T1004 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6e4472f6000b
[junit4:junit4] 2> 17198 T1091 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 17199 T1001 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:20200 which had sessionid 0x13d6e4472f6000b
[junit4:junit4] 2> 17198 T999 oaz.ZooKeeper.close Session: 0x13d6e4472f6000b closed
[junit4:junit4] 2> 17199 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 17212 T999 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:22341/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@13f6325c
[junit4:junit4] 2> 17213 T999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17213 T1092 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:22341. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 17214 T1092 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:22341, initiating session
[junit4:junit4] 2> 17214 T1001 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10640
[junit4:junit4] 2> 17214 T1001 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10640
[junit4:junit4] 2> 17215 T1003 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6e4472f6000c with negotiated timeout 20000 for client /140.211.11.196:10640
[junit4:junit4] 2> 17215 T1092 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:22341, sessionid = 0x13d6e4472f6000c, negotiated timeout = 20000
[junit4:junit4] 2> 17216 T1093 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13f6325c name:ZooKeeperConnection Watcher:127.0.0.1:22341/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17216 T999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17217 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f6000c type:create cxid:0x1 zxid:0x98 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17219 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f6000c type:create cxid:0x2 zxid:0x99 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17227 T999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17731 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17731 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22364__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:22364_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22364"}
[junit4:junit4] 2> 17745 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17745 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17745 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17745 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17745 T1093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17745 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17941 T1035 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:22364__collection1&state=recovering&nodeName=127.0.0.1:22364_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 18230 T999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38389_
[junit4:junit4] 2> 18231 T1004 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6e4472f6000c type:delete cxid:0xd zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:38389_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:38389_
[junit4:junit4] 2> 18232 T999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38389_
[junit4:junit4] 2> 18234 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18234 T1093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18235 T1028 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18235 T1057 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18235 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18235 T1021 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18235 T1074 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18235 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18236 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18236 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18237 T1041 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18237 T1093 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18250 T1094 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363354629356/collection1
[junit4:junit4] 2> 18250 T1094 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 18251 T1094 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 18251 T1094 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 18253 T1094 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363354629356/collection1/'
[junit4:junit4] 2> 18254 T1094 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363354629356/collection1/lib/README' to classloader
[junit4:junit4] 2> 18254 T1094 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363354629356/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 18301 T1094 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 18364 T1094 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18465 T1094 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18471 T1094 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 19067 T1094 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19075 T1094 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19078 T1094 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19090 T1094 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19093 T1094 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19096 T1094 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19097 T1094 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19097 T1094 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19098 T1094 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19098 T1094 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19099 T1094 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19099 T1094 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19099 T1094 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363354629356/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty4/
[junit4:junit4] 2> 19099 T1094 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6477eb97
[junit4:junit4] 2> 19100 T1094 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19100 T1094 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty4 forceNew: false
[junit4:junit4] 2> 19100 T1094 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty4/index/
[junit4:junit4] 2> 19100 T1094 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19101 T1094 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty4/index forceNew: false
[junit4:junit4] 2> 19103 T1094 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53d07a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f7beca),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19103 T1094 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19105 T1094 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19105 T1094 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19105 T1094 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19106 T1094 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19106 T1094 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19106 T1094 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19106 T1094 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19107 T1094 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19107 T1094 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19111 T1094 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19115 T1094 oass.SolrIndexSearcher.<init> Opening Searcher@73533bc2 main
[junit4:junit4] 2> 19116 T1094 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty4/tlog
[junit4:junit4] 2> 19116 T1094 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19116 T1094 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19119 T1095 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@73533bc2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19120 T1094 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 19120 T1094 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19251 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19252 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:38389_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38389"}
[junit4:junit4] 2> 19252 T1022 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 19252 T1022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 19264 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19264 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19264 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19264 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19264 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19264 T1093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> C70_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:22364_, base_url=http://127.0.0.1:22364}
[junit4:junit4] 2> 19942 T1079 C70 P22364 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:22352/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19942 T1079 C70 P22364 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22364 START replicas=[http://127.0.0.1:22352/collection1/] nUpdates=100
[junit4:junit4] 2> 19942 T1079 C70 P22364 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19943 T1079 C70 P22364 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19943 T1079 C70 P22364 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19943 T1079 C70 P22364 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19943 T1079 C70 P22364 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19944 T1079 C70 P22364 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:22352/collection1/. core=collection1
[junit4:junit4] 2> 19944 T1079 C70 P22364 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19945 T1032 C69 P22352 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 19959 T1036 C69 P22352 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19960 T1036 C69 P22352 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 19960 T1036 C69 P22352 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 19960 T1036 C69 P22352 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 19961 T1036 C69 P22352 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 2
[junit4:junit4] 2> 19961 T1079 C70 P22364 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 19961 T1079 C70 P22364 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 19963 T1034 C69 P22352 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 19963 T1079 C70 P22364 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 19964 T1079 C70 P22364 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 19964 T1079 C70 P22364 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 19966 T1034 C69 P22352 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0
[junit4:junit4] 2> 19966 T1079 C70 P22364 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 19967 T1079 C70 P22364 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty3/index.20130315063712425 forceNew: false
[junit4:junit4] 2> 19967 T1079 C70 P22364 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@258fff35 lockFactory=org.apache.lucene.store.NativeFSLockFactory@27a020d6) fullCopy=false
[junit4:junit4] 2> 19970 T1034 C69 P22352 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 19971 T1079 C70 P22364 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 19971 T1079 C70 P22364 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 19972 T1079 C70 P22364 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 19973 T1079 C70 P22364 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a459854 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19b41a92),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a459854 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19b41a92),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 19974 T1079 C70 P22364 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 19974 T1079 C70 P22364 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 19974 T1079 C70 P22364 oass.SolrIndexSearcher.<init> Opening Searcher@2b1ac320 main
[junit4:junit4] 2> 19975 T1076 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b1ac320 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 19975 T1079 C70 P22364 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@258fff35 lockFactory=org.apache.lucene.store.NativeFSLockFactory@27a020d6)
[junit4:junit4] 2> 19976 T1079 C70 P22364 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 19976 T1079 C70 P22364 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 19976 T1079 C70 P22364 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 19976 T1079 C70 P22364 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20003 T1079 C70 P22364 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20150 T1094 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 20150 T1094 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38389 collection:collection1 shard:shard1
[junit4:junit4] 2> 20153 T1094 oasc.ZkController.register We are http://127.0.0.1:38389/collection1/ and leader is http://127.0.0.1:22352/collection1/
[junit4:junit4] 2> 20153 T1094 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38389
[junit4:junit4] 2> 20153 T1094 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 20154 T1094 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C71 name=collection1 org.apache.solr.core.SolrCore@652e74a9 url=http://127.0.0.1:38389/collection1 node=127.0.0.1:38389_ C71_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:38389_, base_url=http://127.0.0.1:38389}
[junit4:junit4] 2> 20154 T1098 C71 P38389 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 20155 T1098 C71 P38389 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 20155 T1094 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20155 T1098 C71 P38389 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 20155 T1098 C71 P38389 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20156 T999 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J0
[junit4:junit4] 2> 20156 T1098 C71 P38389 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20156 T999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 20157 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20168 T999 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20169 T999 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 20170 T999 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 20171 T999 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20768 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20769 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:22364__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:22364_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22364"}
[junit4:junit4] 2> 20800 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:38389__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:38389_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38389"}
[junit4:junit4] 2> 20820 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20820 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20820 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20820 T1093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20820 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20820 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21169 T1037 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:38389__collection1&state=recovering&nodeName=127.0.0.1:38389_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 21172 T999 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22174 T999 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C71_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:38389_, base_url=http://127.0.0.1:38389}
[junit4:junit4] 2> 23171 T1098 C71 P38389 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:22352/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 23171 T1098 C71 P38389 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38389 START replicas=[http://127.0.0.1:22352/collection1/] nUpdates=100
[junit4:junit4] 2> 23171 T1098 C71 P38389 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 23172 T1098 C71 P38389 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 23172 T1098 C71 P38389 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 23172 T1098 C71 P38389 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 23172 T1098 C71 P38389 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 23172 T1098 C71 P38389 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:22352/collection1/. core=collection1
[junit4:junit4] 2> 23172 T1098 C71 P38389 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23174 T1032 C69 P22352 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 23176 T999 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23184 T1031 C69 P22352 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23184 T1031 C69 P22352 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 23185 T1031 C69 P22352 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 23185 T1031 C69 P22352 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23186 T1031 C69 P22352 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 2
[junit4:junit4] 2> 23187 T1098 C71 P38389 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 23187 T1098 C71 P38389 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 23189 T1034 C69 P22352 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 23190 T1098 C71 P38389 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 23190 T1098 C71 P38389 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 23190 T1098 C71 P38389 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 23192 T1034 C69 P22352 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=0
[junit4:junit4] 2> 23193 T1098 C71 P38389 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 23194 T1098 C71 P38389 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.SyncSliceTest-1363354612463/jetty4/index.20130315063715651 forceNew: false
[junit4:junit4] 2> 23194 T1098 C71 P38389 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@50dbd14 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e27b4c2) fullCopy=false
[junit4:junit4] 2> 23197 T1034 C69 P22352 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 23198 T1098 C71 P38389 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 23199 T1098 C71 P38389 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 23199 T1098 C71 P38389 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 23200 T1098 C71 P38389 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53d07a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f7beca),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53d07a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f7beca),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 23201 T1098 C71 P38389 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 23202 T1098 C71 P38389 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 23202 T1098 C71 P38389 oass.SolrIndexSearcher.<init> Opening Searcher@22007b4 main
[junit4:junit4] 2> 23203 T1095 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@22007b4 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 23203 T1098 C71 P38389 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@50dbd14 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e27b4c2)
[junit4:junit4] 2> 23203 T1098 C71 P38389 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 23203 T1098 C71 P38389 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 23204 T1098 C71 P38389 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 23204 T1098 C71 P38389 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 23205 T1098 C71 P38389 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23828 T1022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23829 T1022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:38389__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:38389_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38389"}
[junit4:junit4] 2> 23843 T1028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23843 T1021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23843 T1041 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23843 T1093 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23843 T1057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23843 T1074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24178 T999 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24179 T999 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C72 name=collection1 org.apache.solr.core.SolrCore@7cffe09c url=http://127.0.0.1:22346/collection1 node=127.0.0.1:22346_ C72_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:22346_, base_url=http://127.0.0.1:22346, leader=true}
[junit4:junit4] 2> 24186 T1011 C72 P22346 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24189 T1011 C72 P22346 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13f40fb4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@776977a4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 24189 T1011 C72 P22346 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 24190 T1011 C72 P22346 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13f40fb4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@776977a4),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13f40fb4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@776977a4),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24191 T1011 C72 P22346 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24191 T1011 C72 P22346 oass.SolrIndexSearcher.<init> Opening Searcher@4036f065 main
[junit4:junit4] 2> 24191 T1011 C72 P22346 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24192 T1025 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4036f065 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 24193 T1011 C72 P22346 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 24204 T1033 C69 P22352 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24204 T1033 C69 P22352 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 24205 T1033 C69 P22352 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 24205 T1033 C69 P22352 oass.SolrIndexSearcher.<init> Opening Searcher@3ab1384b main
[junit4:junit4] 2> 24206 T1033 C69 P22352 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24206 T1043 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ab1384b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 24207 T1033 C69 P22352 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:22357/collection1/, StdNode: http://127.0.0.1:22364/collection1/, StdNode: http://127.0.0.1:38389/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> C70_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22364_, base_url=http://127.0.0.1:22364}
[junit4:junit4] 2> 24220 T1064 C70 P22364 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24221 T1064 C70 P22364 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a459854 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19b41a92),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a459854 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19b41a92),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 24221 T1064 C70 P22364 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 24222 T1064 C70 P22364 oass.SolrIndexSearcher.<init> Opening Searcher@67c9166e main
[junit4:junit4] 2> 24222 T1064 C70 P22364 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> C68_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:22357_, base_url=http://127.0.0.1:22357}
[junit4:junit4] 2> 24222 T1047 C68 P22357 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C71_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:38389_, base_url=http://127.0.0.1:38389}
[junit4:junit4] 2> 24222 T1083 C71 P38389 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24223 T1076 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@67c9166e main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 24224 T1083 C71 P38389 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53d07a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f7beca),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53d07a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f7beca),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 24224 T1047 C68 P22357 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16340bd8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b29c110),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16340bd8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b29c110),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 24224 T1064 C70 P22364 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 24225 T1083 C71 P38389 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 24225 T1047 C68 P22357 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 24226 T1083 C71 P38389 oass.SolrIndexSearcher.<init> Opening Searcher@6dbffddf main
[junit4:junit4] 2> 24226 T1047 C68 P22357 oass.SolrIndexSearcher.<init> Opening Searcher@6dbffddf main
[junit4:junit4] 2> 24226 T1083 C71 P38389 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24226 T1047 C68 P22357 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24226 T1095 oasc.JmxMonitoredMap.put WARNING Failed to register info bean: searcher javax.management.InstanceNotFoundException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1118)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:433)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:421)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:541)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:138)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:239)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1763)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:129)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1640)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2>
[junit4:junit4] 2> 24227 T1059 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6dbffddf main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 24228 T1095 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6dbffddf main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 24228 T1047 C68 P22357 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 24228 T1083 C71 P38389 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 24229 T1033 C69 P22352 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 25
[junit4:junit4] 2> 24230 T999 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24233 T1035 C69 P22352 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 24235 T1048 C68 P22357 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 24236 T1065 C70 P22364 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 24238 T1084 C71 P38389 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 26244 T1011 C72 P22346 oass.SolrIndexSearcher.<init> Opening Searcher@700e4f96 realtime
[junit4:junit4] 2> 26245 T1011 C72 P22346 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429580953630539776)} 0 3
[junit4:junit4] 2> 26252 T1047 C68 P22357 /update {update.distrib=FROMLEADER&_version_=-1429580953634734080&update.from=http://127.0.0.1:22352/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429580953634734080)} 0 1
[junit4:junit4] 2> 26252 T1064 C70 P22364 /update {update.distrib=FROMLEADER&_version_=-1429580953634734080&update.from=http://127.0.0.1:22352/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429580953634734080)} 0 1
[junit4:junit4] 2> 26252 T1083 C71 P38389 /update {update.distrib=FROMLEADER&_version_=-1429580953634734080&update.from=http://127.0.0.1:22352/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429580953634734080)} 0 1
[junit4:junit4] 2> 26253 T1033 C69 P22352 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429580953634734080)} 0 6
[junit4:junit4] 2> 26258 T1011 C72 P22346 /update {wt=javabin&version=2} {add=[0 (1429580953644171264)]} 0 2
[junit4:junit4] 2> 26264 T1064 C70 P22364 /update {distrib.from=http://127.0.0.1:22352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429580953648365568)]} 0 1
[junit4:junit4] 2> 26264 T1047 C68 P22357 /update {distrib.from=http://127.0.0.1:22352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429580953648365568)]} 0 1
[junit4:junit4] 2> 26265 T1083 C71 P38389 /update {distrib.from=http://127.0.0.1:22352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429580953648365568)]} 0 2
[junit4:junit4] 2> 26265 T1033 C69 P22352 /update {wt=javabin&version=2} {add=[0 (1429580953648365568)]} 0 5
[junit4:junit4] 2> 26269 T1011 C72 P22346 /update {wt=javabin&version=2} {add=[1 (1429580953656754176)]} 0 1
[junit4:junit4] 2> 26275 T1064 C70 P22364 /update {distrib.from=http://127.0.0.1:22352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429580953659899904)]} 0 1
[junit4:junit4] 2> 26275 T1047 C68 P22357 /update {distrib.from=http://127.0.0.1:22352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429580953659899904)]} 0 1
[junit4:junit4] 2> 26275 T1083 C71 P38389 /update {distrib.from=http://127.0.0.1:22352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429580953659899904)]} 0 1
[junit4:junit4] 2> 26276 T1033 C69 P22352 /update {wt=javabin&version=2} {add=[1 (1429580953659899904)]} 0 5
[junit4:junit4] 2> 26279 T1011 C72 P22346 /update {wt=javabin&version=2} {add=[2 (1429580953667239936)]} 0 1
[junit4:junit4] 2> 26285 T1064 C70 P22364 /update {distrib.from=http://127.0.0.1:22352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429580953670385664)]} 0 1
[junit4:junit4] 2> 26285 T1083 C71 P38389 /update {distrib.from=http://127.0.0.1:22352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429580953670385664)]} 0 1
[junit4:junit4] 2> 26285 T1033 C69 P22352 /update {test.distrib.skip.servers=http://127.0.0.1:22357/collection1/&wt=javabin&version=2} {add=[2 (1429580953670385664)]} 0 4
[junit4:junit4] 2> 26289 T1011 C72 P22346 /update {wt=javabin&version=2} {add=[3 (1429580953677725696)]} 0 1
[junit4:junit4] 2> 26295 T1083 C71 P38389 /update {distrib.from=http://127.0.0.1:22352/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1429580953680871424)]} 0 1
[junit4:junit4] 2> 26295 T1033 C69 P22352 /update {test.distrib.skip.servers=http://127.0.0.1:22357/collection1/&test.distrib.skip.servers=http://127.0.0.1:22364/collection1/&wt=javabin&version=2} {add=[3 (1429580953680871424)]} 0 4
[junit4:junit4] 2> 26298 T1011 C72 P22346 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 26301 T1011 C72 P22346 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13f40fb4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@776977a4),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13f40fb4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@776977a4),segFN=segments_3,generation=3,filenames=[_0_Lucene40_0.tim, _0.fnm, _0_dv.cfs, _0_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0.si, segments_3, _0.fdt, _0_dv.cfe]
[junit4:junit4] 2> 26302 T1011 C72 P22346 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_Lucene40_0.tim, _0.fnm, _0_dv.cfs, _0_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0.si, segments_3, _0.fdt, _0_dv.cfe]
[junit4:junit4] 2> 26303 T1011 C72 P22346 oass.SolrIndexSearcher.<init> Opening Searcher@48c52efb main
[junit4:junit4] 2> 26303 T1011 C72 P22346 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 26304 T1025 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48c52efb main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 26304 T1011 C72 P22346 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 26307 T1033 C69 P22352 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 26310 T1033 C69 P22352 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=5
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f22d615 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6bd7fbbd),segFN=segments_6,generation=6,filenames=[_0_Lucene40_0.tim, _0.fnm, _0_dv.cfs, _0_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0.si, segments_6, _0.fdt, _0_dv.cfe]
[junit4:junit4] 2> 26310 T1033 C69 P22352 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0_Lucene40_0.tim, _0.fnm, _0_dv.cfs, _0_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0.si, segments_6, _0.fdt, _0_dv.cfe]
[junit4:junit4] 2> 26312 T1033 C69 P22352 oass.SolrIndexSearcher.<init> Opening Searcher@7c93b91f main
[junit4:junit4] 2> 26312 T1033 C69 P22352 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 26312 T1043 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7c93b91f main{StandardDirectoryReader(segments_6:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 26313 T1033 C69 P22352 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:22357/collection1/, StdNode: http://127.0.0.1:22364/collection1/, StdNode: http://127.0.0.1:38389/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 26315 T1083 C71 P38389 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 26315 T1047 C68 P22357 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 26316 T1064 C70 P22364 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 26318 T1083 C71 P38389 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53d07a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f7beca),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@53d07a4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65f7beca),segFN=segments_6,generation=6,filenames=[_0_Lucene40_0.tim, _0.fnm, _0_dv.cfs, _0_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0.si, segments_6, _0.fdt, _0_dv.cfe]
[junit4:junit4] 2> 26318 T1047 C68 P22357 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16340bd8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b29c110),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@16340bd8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b29c110),segFN=segments_4,generation=4,filenames=[_0_Lucene40_0.tim, _0.fnm, _0_dv.cfs, _0_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0.si, _0.fdt, segments_4, _0_dv.cfe]
[junit4:junit4] 2> 26318 T1083 C71 P38389 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0_Lucene40_0.tim, _0.fnm, _0_dv.cfs, _0_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0.si, segments_6, _0.fdt, _0_dv.cfe]
[junit4:junit4] 2> 26319 T1047 C68 P22357 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0_Lucene40_0.tim, _0.fnm, _0_dv.cfs, _0_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, _0.si, _0.fdt, segments_4, _0_dv.cfe]
[junit4:junit4] 2> 26319 T1064 C70 P22364 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a459854 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19b41a92),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1a459854 lockFactory=org.apache.lucene.store.NativeFSLockFactory@19b41a92),segFN=segments_5,generation=5,filenames=[_0_Lucene40_0.tim, _0.fnm, _0_dv.cfs, _0_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, segments_5, _0.si, _0.fdt, _0_dv.cfe]
[junit4:junit4] 2> 26320 T1064 C70 P22364 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[_0_Lucene40_0.tim, _0.fnm, _0_dv.cfs, _0_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0_nrm.cfe, _0.fdx, segments_5, _0.si, _0.fdt, _0_dv.cfe]
[junit4:junit4] 2> 26320 T1083 C71 P38389 oass.SolrIndexSearcher.<init> Opening Searcher@6b3c996b main
[junit4:junit4] 2> 26320 T1047 C68 P22357 oass.SolrIndexSearcher.<init> Opening Searcher@c703fb9 main
[junit4:junit4] 2> 26320 T1083 C71 P38389 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 26321 T1047 C68 P22357 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 26321 T1095 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6b3c996b main{StandardDirectoryReader(segments_6:3:nrt _0(5.0):C4)}
[junit4:junit4] 2> 26321 T1064 C70 P22364 oass.SolrIndexSearcher.<init> Opening Searcher@48159a63 main
[junit4:junit4] 2> 26321 T1059 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c703fb9 main{StandardDirectoryReader(segments_4:3:nrt _0(5.0):C2)}
[junit4:junit4] 2> 26321 T1083 C71 P38389 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 26322 T1064 C70 P22364 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 26322 T1047 C68 P22357 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 26322 T1076 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48159a63 main{StandardDirectoryReader(segments_5:3:nrt _0(5.0):C3)}
[junit4:junit4] 2> 26323 T1064 C70 P22364 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 26323 T1033 C69 P22352 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4] 2> 26324 T999 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 26325 T999 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26326 T999 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 26328 T1035 C69 P22352 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 26331 T1048 C68 P22357 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=2 status=0 QTime=0
[junit4:junit4] 2> 26334 T1065 C70 P22364 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=3 status=0 QTime=0
[junit4:junit4] 2> 26337 T1084 C71 P38389 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=4 status=0 QTime=0
[junit4:junit4] 2> 26338 T999 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 26350 T1066 oasha.CollectionsHandler.handleSyncShardAction Syncing shard : shard=shard1&action=SYNCSHARD&collection=collection1&wt=javabin&version=2
[junit4:junit4] 2> 26351 T1066 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 26362 T1036 oasha.CoreAdminHandler.handleRequestSyncAction I have been requested to sync up my shard
[junit4:junit4] 2> 26363 T1036 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22352/collection1/
[junit4:junit4] 2> 26363 T1036 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22352 START replicas=[http://127.0.0.1:22357/collection1/, http://127.0.0.1:22364/collection1/, http://127.0.0.1:38389/collection1/] nUpdates=100
[junit4:junit4] 2> 26365 T1049 C68 P22357 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 26365 T1067 C70 P22364 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 26366 T1085 C71 P38389 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 26366 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:22352 Received 3 versions from 127.0.0.1:22357/collection1/
[junit4:junit4] 2> 26366 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:22352 Our versions are newer. ourLowThreshold=1429580953634734080 otherHigh=1429580953659899904
[junit4:junit4] 2> 26367 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:22352 Received 4 versions from 127.0.0.1:22364/collection1/
[junit4:junit4] 2> 26367 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:22352 Our versions are newer. ourLowThreshold=1429580953634734080 otherHigh=1429580953670385664
[junit4:junit4] 2> 26367 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:22352 Received 5 versions from 127.0.0.1:38389/collection1/
[junit4:junit4] 2> 26368 T1036 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:22352 Our versions are newer. ourLowThreshold=1429580953634734080 otherHigh=1429580953670385664
[junit4:junit4] 2> 26368 T1036 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22352 DONE. sync succeeded
[junit4:junit4] 2> 26368 T1036 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 26369 T1036 oasc.SyncStrategy.syncToMe http://127.0.0.1:22352/collection1/: try and ask http://127.0.0.1:22357/collection1/ to sync
[junit4:junit4] 2> 26369 T1036 oasc.SyncStrategy.syncToMe http://127.0.0.1:22352/collection1/: try and ask http://127.0.0.1:22364/collection1/ to sync
[junit4:junit4] 2> 26370 T1036 oasc.SyncStrategy.syncToMe http://127.0.0.1:22352/collection1/: try and ask http://127.0.0.1:38389/collection1/ to sync
[junit4:junit4] 2> 26370 T1050 C68 P22357 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22357 START replicas=[http://127.0.0.1:22352/collection1/] nUpdates=100
[junit4:junit4] 2> 26371 T1068 C70 P22364 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:22364 START replicas=[http://127.0.0.1:22352/collection1/] nUpdates=100
[junit4:junit4] 2> 26371 T1086 C71 P38389 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38389 START replicas=[http://127.0.0.1:22352/collection1/] nUpdates=100
[junit4:junit4] 2> 26372 T1037 C69 P22352 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 26373 T1031 C69 P22352 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 26373 T1068 C70 P22364 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:22364 Received 5 versions from 127.0.0.1:22352/collection1/
[junit4:junit4] 2> 26373 T1032 C69 P22352 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 26373 T1086 C71 P38389 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=http://127.0.0.1:38389 Received 5 versions from 127.0.0.1:22352/collection1/
[junit4:junit4] 2> 26373 T1068 C70 P22364 oasu.PeerSync.requestUpdates PeerSync: core=collection1 url=http://127.0.0.1:22364 Requesting updates from
[...truncated too long message...]
9 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 139753 T1004 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4] 2> 139753 T999 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 139754 T1003 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4] 2> 139755 T999 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 2> 139757 T999 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:22341 22341
[junit4:junit4] 2> 139890 T1001 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4] 2> 139891 T999 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4] 2> 139892 T999 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4] 2> 139892 T999 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 139893 T999 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 139893 T999 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=A1E6A0DE354761F0 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_PR -Dtests.timezone=America/Whitehorse -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 140s J0 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:22357/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:38389/collection1], CloudJettyRunner [url=http://127.0.0.1:38389/collection1]]
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([A1E6A0DE354761F0:20002EC6421801CC]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4] > at org.junit.Assert.assertNotNull(Assert.java:526)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2> 139942 T999 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 139949 T998 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> 140543 T1002 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop!
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=es_PR, timezone=America/Whitehorse
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=5,free=61495216,total=452198400
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestLFUCache, AutoCommitTest, TestStressVersions, SolrCoreTest, SliceStateTest, SolrInfoMBeanTest, ZkCLITest, TestReversedWildcardFilterFactory, PluginInfoTest, TermVectorComponentTest, TestPseudoReturnFields, TestSurroundQueryParser, SystemInfoHandlerTest, FieldMutatingUpdateProcessorTest, MBeansHandlerTest, DistributedQueryElevationComponentTest, SliceStateUpdateTest, ClusterStateUpdateTest, BasicDistributedZkTest, QueryElevationComponentTest, DateFieldTest, SchemaVersionSpecificBehaviorTest, CacheHeaderTest, UpdateRequestProcessorFactoryTest, BadComponentTest, TestSolrQueryParser, SolrIndexSplitterTest, TestLRUCache, TestDocSet, TestFastLRUCache, TestFaceting, TestJoin, CoreAdminHandlerTest, TestSort, StatelessScriptUpdateProcessorFactoryTest, DirectSolrConnectionTest, TestSolrIndexConfig, AlternateDirectoryTest, QueryEqualityTest, LukeRequestHandlerTest, SyncSliceTest]
[junit4:junit4] Completed on J0 in 140.73s, 1 test, 1 failure <<< FAILURES!
[...truncated 515 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/lucene/common-build.xml:877: There were test failures: 272 suites, 1144 tests, 1 failure, 27 ignored (8 assumptions)
Total time: 57 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-trunk-Java6 - Build # 16005 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-Java6/16005/
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
No registered leader was found, collection:collection1 slice:shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found, collection:collection1 slice:shard1
at __randomizedtesting.SeedInfo.seed([2A7F3D9CF10D9610:AB99B3848652F62C]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:484)
at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:291)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:116)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 8576 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T1648 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /idf/
[junit4:junit4] 2> 3 T1648 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363332425525
[junit4:junit4] 2> 4 T1648 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 5 T1649 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 8 T1649 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 8 T1649 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 8 T1649 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 8 T1649 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 9 T1649 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 105 T1648 oasc.ZkTestServer.run start zk server on port:47880
[junit4:junit4] 2> 105 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@67b58dfa
[junit4:junit4] 2> 106 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 107 T1654 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 107 T1654 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 107 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:15814
[junit4:junit4] 2> 108 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:15814
[junit4:junit4] 2> 108 T1652 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 110 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b0000 with negotiated timeout 10000 for client /140.211.11.196:15814
[junit4:junit4] 2> 110 T1654 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b0000, negotiated timeout = 10000
[junit4:junit4] 2> 110 T1655 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67b58dfa name:ZooKeeperConnection Watcher:127.0.0.1:47880 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 111 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 111 T1648 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 114 T1653 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1e73b0000
[junit4:junit4] 2> 121 T1655 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 121 T1650 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:15814 which had sessionid 0x13d6cf1e73b0000
[junit4:junit4] 2> 121 T1648 oaz.ZooKeeper.close Session: 0x13d6cf1e73b0000 closed
[junit4:junit4] 2> 122 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@30172311
[junit4:junit4] 2> 122 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 123 T1656 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 123 T1656 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 123 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:63221
[junit4:junit4] 2> 124 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:63221
[junit4:junit4] 2> 124 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b0001 with negotiated timeout 10000 for client /140.211.11.196:63221
[junit4:junit4] 2> 125 T1656 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b0001, negotiated timeout = 10000
[junit4:junit4] 2> 125 T1657 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30172311 name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 125 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 125 T1648 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 136 T1648 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 139 T1648 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 141 T1648 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 144 T1648 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 145 T1648 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 158 T1648 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 159 T1648 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 275 T1648 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 276 T1648 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 279 T1648 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 279 T1648 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 296 T1648 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 296 T1648 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 299 T1648 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 300 T1648 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 302 T1648 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 303 T1648 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 305 T1648 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 306 T1648 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 313 T1648 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 314 T1648 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 316 T1653 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1e73b0001
[junit4:junit4] 2> 317 T1657 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 318 T1650 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:63221 which had sessionid 0x13d6cf1e73b0001
[junit4:junit4] 2> 317 T1648 oaz.ZooKeeper.close Session: 0x13d6cf1e73b0001 closed
[junit4:junit4] 2> 513 T1648 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 516 T1648 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:65311
[junit4:junit4] 2> 517 T1648 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 517 T1648 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 518 T1648 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363332425839
[junit4:junit4] 2> 518 T1648 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363332425839/solr.xml
[junit4:junit4] 2> 519 T1648 oasc.CoreContainer.<init> New CoreContainer 1486608012
[junit4:junit4] 2> 519 T1648 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363332425839/'
[junit4:junit4] 2> 520 T1648 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363332425839/'
[junit4:junit4] 2> 575 T1648 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 575 T1648 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 576 T1648 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 576 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 577 T1648 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 577 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 578 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 578 T1648 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 578 T1648 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 579 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 601 T1648 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 619 T1648 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:47880/solr
[junit4:junit4] 2> 619 T1648 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 620 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5e0079f5
[junit4:junit4] 2> 621 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 621 T1667 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 622 T1667 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 622 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:32043
[junit4:junit4] 2> 623 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:32043
[junit4:junit4] 2> 624 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b0002 with negotiated timeout 20000 for client /140.211.11.196:32043
[junit4:junit4] 2> 624 T1667 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b0002, negotiated timeout = 20000
[junit4:junit4] 2> 624 T1668 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e0079f5 name:ZooKeeperConnection Watcher:127.0.0.1:47880 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 625 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 626 T1653 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1e73b0002
[junit4:junit4] 2> 634 T1668 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 634 T1650 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:32043 which had sessionid 0x13d6cf1e73b0002
[junit4:junit4] 2> 634 T1648 oaz.ZooKeeper.close Session: 0x13d6cf1e73b0002 closed
[junit4:junit4] 2> 635 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 643 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2f5c36fb
[junit4:junit4] 2> 644 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 644 T1669 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 644 T1669 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 644 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:50845
[junit4:junit4] 2> 645 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:50845
[junit4:junit4] 2> 646 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b0003 with negotiated timeout 20000 for client /140.211.11.196:50845
[junit4:junit4] 2> 646 T1669 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b0003, negotiated timeout = 20000
[junit4:junit4] 2> 646 T1670 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f5c36fb name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 646 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 653 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 654 T1648 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 657 T1648 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65311_idf
[junit4:junit4] 2> 657 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:65311_idf Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:65311_idf
[junit4:junit4] 2> 658 T1648 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65311_idf
[junit4:junit4] 2> 667 T1648 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 676 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 678 T1648 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 687 T1648 oasc.Overseer.start Overseer (id=89347353839599619-127.0.0.1:65311_idf-n_0000000000) starting
[junit4:junit4] 2> 688 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 689 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 690 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 699 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 700 T1672 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 701 T1648 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 711 T1648 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 712 T1648 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 714 T1671 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 719 T1673 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363332425839/collection1
[junit4:junit4] 2> 719 T1673 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 719 T1673 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 719 T1673 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 720 T1673 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363332425839/collection1/'
[junit4:junit4] 2> 721 T1673 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363332425839/collection1/lib/README' to classloader
[junit4:junit4] 2> 722 T1673 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363332425839/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 754 T1673 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 792 T1673 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 893 T1673 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 897 T1673 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1316 T1673 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1324 T1673 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1327 T1673 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1339 T1673 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1343 T1673 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1346 T1673 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1347 T1673 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1347 T1673 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1348 T1673 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1349 T1673 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1349 T1673 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1349 T1673 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1349 T1673 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1363332425839/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/control/data/
[junit4:junit4] 2> 1349 T1673 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@962522b
[junit4:junit4] 2> 1350 T1673 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1350 T1673 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/control/data forceNew: false
[junit4:junit4] 2> 1350 T1673 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/control/data/index/
[junit4:junit4] 2> 1350 T1673 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1351 T1673 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/control/data/index forceNew: false
[junit4:junit4] 2> 1353 T1673 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@496cff2a lockFactory=org.apache.lucene.store.NativeFSLockFactory@48303e79),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1353 T1673 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1355 T1673 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1355 T1673 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1355 T1673 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1356 T1673 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1356 T1673 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1356 T1673 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1356 T1673 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1357 T1673 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1357 T1673 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1362 T1673 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1366 T1673 oass.SolrIndexSearcher.<init> Opening Searcher@3ef2de86 main
[junit4:junit4] 2> 1366 T1673 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/control/data/tlog
[junit4:junit4] 2> 1367 T1673 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1367 T1673 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1369 T1674 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ef2de86 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1370 T1673 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1370 T1673 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1370 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2218 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2218 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:65311_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65311/idf"}
[junit4:junit4] 2> 2219 T1671 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2219 T1671 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2219 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2240 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2388 T1673 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2388 T1673 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65311/idf collection:control_collection shard:shard1
[junit4:junit4] 2> 2389 T1673 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2406 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2407 T1673 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2407 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2409 T1673 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2409 T1673 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2409 T1673 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65311/idf/collection1/
[junit4:junit4] 2> 2409 T1673 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2409 T1673 oasc.SyncStrategy.syncToMe http://127.0.0.1:65311/idf/collection1/ has no replicas
[junit4:junit4] 2> 2409 T1673 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65311/idf/collection1/
[junit4:junit4] 2> 2410 T1673 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2413 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3743 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3791 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3843 T1673 oasc.ZkController.register We are http://127.0.0.1:65311/idf/collection1/ and leader is http://127.0.0.1:65311/idf/collection1/
[junit4:junit4] 2> 3843 T1673 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65311/idf
[junit4:junit4] 2> 3843 T1673 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3843 T1673 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3844 T1673 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3846 T1673 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3847 T1648 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3847 T1648 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3848 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3863 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3864 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@48659e2e
[junit4:junit4] 2> 3865 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3865 T1676 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 3866 T1676 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 3866 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:47926
[junit4:junit4] 2> 3866 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:47926
[junit4:junit4] 2> 3867 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b0004 with negotiated timeout 10000 for client /140.211.11.196:47926
[junit4:junit4] 2> 3867 T1676 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b0004, negotiated timeout = 10000
[junit4:junit4] 2> 3868 T1677 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48659e2e name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3868 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3869 T1648 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3871 T1648 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4069 T1648 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4071 T1648 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:57179
[junit4:junit4] 2> 4072 T1648 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4072 T1648 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4073 T1648 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392
[junit4:junit4] 2> 4073 T1648 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/solr.xml
[junit4:junit4] 2> 4074 T1648 oasc.CoreContainer.<init> New CoreContainer 826063978
[junit4:junit4] 2> 4074 T1648 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/'
[junit4:junit4] 2> 4075 T1648 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/'
[junit4:junit4] 2> 4123 T1648 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4124 T1648 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4124 T1648 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4124 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4125 T1648 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4125 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4126 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4126 T1648 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4127 T1648 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4127 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4148 T1648 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4168 T1648 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:47880/solr
[junit4:junit4] 2> 4168 T1648 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4169 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@43f3638e
[junit4:junit4] 2> 4170 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4170 T1687 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4171 T1687 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 4171 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64328
[junit4:junit4] 2> 4171 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64328
[junit4:junit4] 2> 4173 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b0005 with negotiated timeout 20000 for client /140.211.11.196:64328
[junit4:junit4] 2> 4173 T1687 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b0005, negotiated timeout = 20000
[junit4:junit4] 2> 4174 T1688 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43f3638e name:ZooKeeperConnection Watcher:127.0.0.1:47880 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4174 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4175 T1653 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1e73b0005
[junit4:junit4] 2> 4188 T1688 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4188 T1650 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:64328 which had sessionid 0x13d6cf1e73b0005
[junit4:junit4] 2> 4187 T1648 oaz.ZooKeeper.close Session: 0x13d6cf1e73b0005 closed
[junit4:junit4] 2> 4188 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4196 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6d49c28e
[junit4:junit4] 2> 4197 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4197 T1689 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4197 T1689 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 4198 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48097
[junit4:junit4] 2> 4198 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48097
[junit4:junit4] 2> 4199 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b0006 with negotiated timeout 20000 for client /140.211.11.196:48097
[junit4:junit4] 2> 4199 T1689 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b0006, negotiated timeout = 20000
[junit4:junit4] 2> 4199 T1690 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d49c28e name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4200 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4200 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4202 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4210 T1648 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5220 T1648 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57179_idf
[junit4:junit4] 2> 5221 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57179_idf Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57179_idf
[junit4:junit4] 2> 5223 T1648 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57179_idf
[junit4:junit4] 2> 5226 T1690 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5226 T1677 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5226 T1670 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5227 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5241 T1691 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/collection1
[junit4:junit4] 2> 5241 T1691 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5242 T1691 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5242 T1691 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5243 T1691 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/collection1/'
[junit4:junit4] 2> 5244 T1691 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5244 T1691 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/collection1/lib/README' to classloader
[junit4:junit4] 2> 5280 T1691 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5304 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5305 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:65311_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:65311/idf"}
[junit4:junit4] 2> 5318 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5318 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5318 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5326 T1691 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5428 T1691 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5434 T1691 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6045 T1691 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6060 T1691 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6065 T1691 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6077 T1691 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6082 T1691 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6085 T1691 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6086 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6087 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6087 T1691 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6088 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6088 T1691 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6088 T1691 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6089 T1691 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty1/
[junit4:junit4] 2> 6089 T1691 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@962522b
[junit4:junit4] 2> 6089 T1691 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6090 T1691 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty1 forceNew: false
[junit4:junit4] 2> 6090 T1691 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty1/index/
[junit4:junit4] 2> 6090 T1691 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6091 T1691 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty1/index forceNew: false
[junit4:junit4] 2> 6093 T1691 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45c8fad1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7eeb6440),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6093 T1691 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6096 T1691 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6096 T1691 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6096 T1691 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6097 T1691 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6097 T1691 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6098 T1691 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6098 T1691 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6098 T1691 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6099 T1691 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6105 T1691 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6111 T1691 oass.SolrIndexSearcher.<init> Opening Searcher@662523bc main
[junit4:junit4] 2> 6111 T1691 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty1/tlog
[junit4:junit4] 2> 6112 T1691 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6112 T1691 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6116 T1692 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@662523bc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6117 T1691 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6118 T1691 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6830 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6831 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57179_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57179/idf"}
[junit4:junit4] 2> 6831 T1671 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6831 T1671 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6847 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6847 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6848 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7122 T1691 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7122 T1691 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57179/idf collection:collection1 shard:shard1
[junit4:junit4] 2> 7123 T1691 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7174 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7175 T1691 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7175 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7185 T1691 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7185 T1691 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7186 T1691 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57179/idf/collection1/
[junit4:junit4] 2> 7186 T1691 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7186 T1691 oasc.SyncStrategy.syncToMe http://127.0.0.1:57179/idf/collection1/ has no replicas
[junit4:junit4] 2> 7186 T1691 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57179/idf/collection1/
[junit4:junit4] 2> 7186 T1691 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7189 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8352 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8383 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8383 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8383 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8422 T1691 oasc.ZkController.register We are http://127.0.0.1:57179/idf/collection1/ and leader is http://127.0.0.1:57179/idf/collection1/
[junit4:junit4] 2> 8422 T1691 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57179/idf
[junit4:junit4] 2> 8422 T1691 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8422 T1691 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8422 T1691 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8424 T1691 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8425 T1648 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8426 T1648 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8426 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8634 T1648 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8637 T1648 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:18313
[junit4:junit4] 2> 8637 T1648 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8638 T1648 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8638 T1648 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363332433963
[junit4:junit4] 2> 8639 T1648 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363332433963/solr.xml
[junit4:junit4] 2> 8639 T1648 oasc.CoreContainer.<init> New CoreContainer 1170924492
[junit4:junit4] 2> 8640 T1648 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363332433963/'
[junit4:junit4] 2> 8640 T1648 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363332433963/'
[junit4:junit4] 2> 8695 T1648 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8696 T1648 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8696 T1648 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8697 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8697 T1648 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8698 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8698 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8699 T1648 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8699 T1648 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8699 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8722 T1648 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8742 T1648 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:47880/solr
[junit4:junit4] 2> 8743 T1648 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8743 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6152d6dd
[junit4:junit4] 2> 8744 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8745 T1703 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8746 T1703 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 8746 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:51634
[junit4:junit4] 2> 8746 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:51634
[junit4:junit4] 2> 8748 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b0007 with negotiated timeout 20000 for client /140.211.11.196:51634
[junit4:junit4] 2> 8748 T1703 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b0007, negotiated timeout = 20000
[junit4:junit4] 2> 8749 T1704 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6152d6dd name:ZooKeeperConnection Watcher:127.0.0.1:47880 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8749 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8750 T1653 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1e73b0007
[junit4:junit4] 2> 8764 T1704 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8764 T1650 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51634 which had sessionid 0x13d6cf1e73b0007
[junit4:junit4] 2> 8764 T1648 oaz.ZooKeeper.close Session: 0x13d6cf1e73b0007 closed
[junit4:junit4] 2> 8764 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8778 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@658a19e5
[junit4:junit4] 2> 8779 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8779 T1705 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8779 T1705 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 8780 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64402
[junit4:junit4] 2> 8780 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64402
[junit4:junit4] 2> 8781 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b0008 with negotiated timeout 20000 for client /140.211.11.196:64402
[junit4:junit4] 2> 8781 T1705 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b0008, negotiated timeout = 20000
[junit4:junit4] 2> 8782 T1706 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@658a19e5 name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8782 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8783 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8784 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8793 T1648 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9796 T1648 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:18313_idf
[junit4:junit4] 2> 9798 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:18313_idf Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:18313_idf
[junit4:junit4] 2> 9799 T1648 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:18313_idf
[junit4:junit4] 2> 9802 T1670 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9803 T1677 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9803 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9803 T1690 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9803 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9803 T1706 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9803 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9825 T1707 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363332433963/collection1
[junit4:junit4] 2> 9825 T1707 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9826 T1707 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9826 T1707 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9827 T1707 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363332433963/collection1/'
[junit4:junit4] 2> 9829 T1707 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363332433963/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9829 T1707 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363332433963/collection1/lib/README' to classloader
[junit4:junit4] 2> 9877 T1707 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 9913 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9914 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57179_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57179/idf"}
[junit4:junit4] 2> 9926 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9926 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9926 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9926 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9932 T1707 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10033 T1707 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10039 T1707 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10622 T1707 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10633 T1707 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10637 T1707 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10651 T1707 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10656 T1707 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10660 T1707 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10660 T1707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10661 T1707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10661 T1707 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10662 T1707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10662 T1707 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10663 T1707 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 10663 T1707 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1363332433963/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty2/
[junit4:junit4] 2> 10663 T1707 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@962522b
[junit4:junit4] 2> 10664 T1707 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 10664 T1707 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty2 forceNew: false
[junit4:junit4] 2> 10664 T1707 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty2/index/
[junit4:junit4] 2> 10665 T1707 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10665 T1707 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty2/index forceNew: false
[junit4:junit4] 2> 10668 T1707 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@46c101bf lockFactory=org.apache.lucene.store.NativeFSLockFactory@4510764a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10668 T1707 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10670 T1707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10670 T1707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10671 T1707 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10671 T1707 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10672 T1707 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10672 T1707 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10672 T1707 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10673 T1707 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10673 T1707 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10680 T1707 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10686 T1707 oass.SolrIndexSearcher.<init> Opening Searcher@44f37b4 main
[junit4:junit4] 2> 10686 T1707 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty2/tlog
[junit4:junit4] 2> 10687 T1707 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10687 T1707 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10691 T1708 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@44f37b4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10693 T1707 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10693 T1707 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11431 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11432 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:18313_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:18313/idf"}
[junit4:junit4] 2> 11432 T1671 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11432 T1671 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 11448 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11448 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11448 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11449 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11696 T1707 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11696 T1707 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:18313/idf collection:collection1 shard:shard2
[junit4:junit4] 2> 11697 T1707 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 11715 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 11716 T1707 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 11717 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11728 T1707 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 11728 T1707 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 11728 T1707 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:18313/idf/collection1/
[junit4:junit4] 2> 11728 T1707 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 11728 T1707 oasc.SyncStrategy.syncToMe http://127.0.0.1:18313/idf/collection1/ has no replicas
[junit4:junit4] 2> 11729 T1707 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:18313/idf/collection1/
[junit4:junit4] 2> 11729 T1707 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 11732 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12955 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13059 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13059 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13059 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13059 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13069 T1707 oasc.ZkController.register We are http://127.0.0.1:18313/idf/collection1/ and leader is http://127.0.0.1:18313/idf/collection1/
[junit4:junit4] 2> 13069 T1707 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:18313/idf
[junit4:junit4] 2> 13069 T1707 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 13069 T1707 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 13069 T1707 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13092 T1707 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13094 T1648 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 13094 T1648 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 13095 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 13432 T1648 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 13436 T1648 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43388
[junit4:junit4] 2> 13437 T1648 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 13437 T1648 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 13438 T1648 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363332438640
[junit4:junit4] 2> 13439 T1648 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363332438640/solr.xml
[junit4:junit4] 2> 13439 T1648 oasc.CoreContainer.<init> New CoreContainer 28134358
[junit4:junit4] 2> 13440 T1648 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363332438640/'
[junit4:junit4] 2> 13441 T1648 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363332438640/'
[junit4:junit4] 2> 13518 T1648 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 13519 T1648 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 13520 T1648 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 13520 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 13521 T1648 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 13522 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 13522 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 13523 T1648 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 13524 T1648 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 13524 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 13544 T1648 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 13562 T1648 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:47880/solr
[junit4:junit4] 2> 13563 T1648 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 13563 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1c6f5871
[junit4:junit4] 2> 13564 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13565 T1719 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 13566 T1719 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 13566 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16438
[junit4:junit4] 2> 13566 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16438
[junit4:junit4] 2> 13597 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b0009 with negotiated timeout 20000 for client /140.211.11.196:16438
[junit4:junit4] 2> 13597 T1719 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b0009, negotiated timeout = 20000
[junit4:junit4] 2> 13597 T1720 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c6f5871 name:ZooKeeperConnection Watcher:127.0.0.1:47880 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13597 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13599 T1653 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1e73b0009
[junit4:junit4] 2> 13611 T1720 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 13611 T1650 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:16438 which had sessionid 0x13d6cf1e73b0009
[junit4:junit4] 2> 13611 T1648 oaz.ZooKeeper.close Session: 0x13d6cf1e73b0009 closed
[junit4:junit4] 2> 13612 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 13623 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@6f9c6850
[junit4:junit4] 2> 13625 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13625 T1721 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 13626 T1721 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 13626 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:23201
[junit4:junit4] 2> 13626 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:23201
[junit4:junit4] 2> 13639 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b000a with negotiated timeout 20000 for client /140.211.11.196:23201
[junit4:junit4] 2> 13639 T1721 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b000a, negotiated timeout = 20000
[junit4:junit4] 2> 13639 T1722 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f9c6850 name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13640 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13641 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13642 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13645 T1648 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14567 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14567 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:18313_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:18313/idf"}
[junit4:junit4] 2> 14575 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14575 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14575 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14575 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14575 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14648 T1648 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43388_idf
[junit4:junit4] 2> 14649 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b000a type:delete cxid:0xd zxid:0x96 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:43388_idf Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:43388_idf
[junit4:junit4] 2> 14651 T1648 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43388_idf
[junit4:junit4] 2> 14653 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14653 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14654 T1677 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14654 T1670 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14654 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14654 T1690 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14654 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14654 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14655 T1706 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14655 T1722 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14662 T1723 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363332438640/collection1
[junit4:junit4] 2> 14662 T1723 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14663 T1723 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14663 T1723 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14664 T1723 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363332438640/collection1/'
[junit4:junit4] 2> 14666 T1723 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363332438640/collection1/lib/README' to classloader
[junit4:junit4] 2> 14666 T1723 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363332438640/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14719 T1723 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14781 T1723 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14882 T1723 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14888 T1723 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15478 T1723 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15485 T1723 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15488 T1723 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15499 T1723 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15503 T1723 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15506 T1723 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15507 T1723 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15508 T1723 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15508 T1723 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15509 T1723 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15509 T1723 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15509 T1723 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15509 T1723 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1363332438640/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty3/
[junit4:junit4] 2> 15510 T1723 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@962522b
[junit4:junit4] 2> 15510 T1723 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15511 T1723 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty3 forceNew: false
[junit4:junit4] 2> 15511 T1723 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty3/index/
[junit4:junit4] 2> 15511 T1723 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15511 T1723 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty3/index forceNew: false
[junit4:junit4] 2> 15513 T1723 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5f9b82a7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@712d4990),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15513 T1723 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15515 T1723 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15515 T1723 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15515 T1723 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15516 T1723 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15516 T1723 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15516 T1723 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15517 T1723 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15517 T1723 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15517 T1723 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15522 T1723 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15527 T1723 oass.SolrIndexSearcher.<init> Opening Searcher@5192a545 main
[junit4:junit4] 2> 15527 T1723 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty3/tlog
[junit4:junit4] 2> 15528 T1723 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15528 T1723 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15532 T1724 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5192a545 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15533 T1723 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15533 T1723 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16080 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16081 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:43388_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43388/idf"}
[junit4:junit4] 2> 16081 T1671 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 16082 T1671 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16095 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16095 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16095 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16095 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16095 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16536 T1723 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16536 T1723 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43388/idf collection:collection1 shard:shard1
[junit4:junit4] 2> 16540 T1723 oasc.ZkController.register We are http://127.0.0.1:43388/idf/collection1/ and leader is http://127.0.0.1:57179/idf/collection1/
[junit4:junit4] 2> 16540 T1723 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43388/idf
[junit4:junit4] 2> 16540 T1723 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16541 T1723 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C238 name=collection1 org.apache.solr.core.SolrCore@3c938f1c url=http://127.0.0.1:43388/idf/collection1 node=127.0.0.1:43388_idf C238_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:43388_idf, base_url=http://127.0.0.1:43388/idf}
[junit4:junit4] 2> 16541 T1725 C238 P43388 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16542 T1725 C238 P43388 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16542 T1723 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16542 T1725 C238 P43388 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16542 T1725 C238 P43388 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16543 T1648 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 16544 T1648 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16544 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16550 T1725 C238 P43388 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16758 T1648 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 16761 T1648 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:57030
[junit4:junit4] 2> 16762 T1648 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 16762 T1648 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 16763 T1648 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363332442084
[junit4:junit4] 2> 16763 T1648 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363332442084/solr.xml
[junit4:junit4] 2> 16764 T1648 oasc.CoreContainer.<init> New CoreContainer 396692081
[junit4:junit4] 2> 16764 T1648 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363332442084/'
[junit4:junit4] 2> 16765 T1648 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363332442084/'
[junit4:junit4] 2> 16815 T1648 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 16816 T1648 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 16816 T1648 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 16817 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 16817 T1648 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 16817 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 16818 T1648 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 16818 T1648 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 16819 T1648 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 16819 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 16841 T1648 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 16864 T1648 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:47880/solr
[junit4:junit4] 2> 16865 T1648 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 16866 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@385bbcb1
[junit4:junit4] 2> 16867 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16867 T1736 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 16868 T1736 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 16868 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:39290
[junit4:junit4] 2> 16868 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:39290
[junit4:junit4] 2> 16870 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b000b with negotiated timeout 20000 for client /140.211.11.196:39290
[junit4:junit4] 2> 16870 T1736 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b000b, negotiated timeout = 20000
[junit4:junit4] 2> 16871 T1737 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@385bbcb1 name:ZooKeeperConnection Watcher:127.0.0.1:47880 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16871 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16872 T1653 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d6cf1e73b000b
[junit4:junit4] 2> 16874 T1737 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 16874 T1650 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:39290 which had sessionid 0x13d6cf1e73b000b
[junit4:junit4] 2> 16874 T1648 oaz.ZooKeeper.close Session: 0x13d6cf1e73b000b closed
[junit4:junit4] 2> 16874 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 16886 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a9195e0
[junit4:junit4] 2> 16887 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 16888 T1738 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 16888 T1738 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 16888 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:32109
[junit4:junit4] 2> 16889 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:32109
[junit4:junit4] 2> 16890 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b000c with negotiated timeout 20000 for client /140.211.11.196:32109
[junit4:junit4] 2> 16890 T1738 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b000c, negotiated timeout = 20000
[junit4:junit4] 2> 16890 T1739 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a9195e0 name:ZooKeeperConnection Watcher:127.0.0.1:47880/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 16891 T1648 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 16892 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b000c type:create cxid:0x1 zxid:0xa3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16893 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b000c type:create cxid:0x2 zxid:0xa4 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 16895 T1648 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 17599 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17600 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:43388_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43388/idf"}
[junit4:junit4] 2> 17614 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17614 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17614 T1739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17614 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17614 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17614 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17898 T1648 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57030_idf
[junit4:junit4] 2> 17899 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b000c type:delete cxid:0xd zxid:0xa9 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57030_idf Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57030_idf
[junit4:junit4] 2> 17904 T1648 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57030_idf
[junit4:junit4] 2> 17933 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17933 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17933 T1677 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17934 T1690 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17934 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17934 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17934 T1739 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17934 T1670 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17934 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17934 T1739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17935 T1722 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17935 T1706 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 17969 T1740 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363332442084/collection1
[junit4:junit4] 2> 17969 T1740 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 17970 T1740 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 17970 T1740 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 17971 T1740 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363332442084/collection1/'
[junit4:junit4] 2> 17972 T1740 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363332442084/collection1/lib/README' to classloader
[junit4:junit4] 2> 17973 T1740 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363332442084/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 18026 T1740 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 18089 T1740 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18190 T1740 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18196 T1740 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 18567 T1680 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=4&state=recovering&nodeName=127.0.0.1:43388_idf&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 19476 T1740 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19487 T1740 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19492 T1740 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19506 T1740 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19511 T1740 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19515 T1740 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19516 T1740 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19517 T1740 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19517 T1740 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19518 T1740 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19518 T1740 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19518 T1740 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19518 T1740 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1363332442084/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4/
[junit4:junit4] 2> 19519 T1740 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@962522b
[junit4:junit4] 2> 19519 T1740 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19520 T1740 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4 forceNew: false
[junit4:junit4] 2> 19520 T1740 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4/index/
[junit4:junit4] 2> 19520 T1740 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19521 T1740 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4/index forceNew: false
[junit4:junit4] 2> 19524 T1740 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@78ffcbf7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5d697666),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19524 T1740 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19526 T1740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19527 T1740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19527 T1740 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19528 T1740 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19528 T1740 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19529 T1740 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19529 T1740 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19530 T1740 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19530 T1740 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19537 T1740 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19543 T1740 oass.SolrIndexSearcher.<init> Opening Searcher@7f72b53c main
[junit4:junit4] 2> 19543 T1740 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4/tlog
[junit4:junit4] 2> 19544 T1740 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19544 T1740 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19548 T1741 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7f72b53c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19550 T1740 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 19550 T1740 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> C238_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:43388_idf, base_url=http://127.0.0.1:43388/idf}
[junit4:junit4] 2> 20570 T1725 C238 P43388 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:57179/idf/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20570 T1725 C238 P43388 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:43388/idf START replicas=[http://127.0.0.1:57179/idf/collection1/] nUpdates=100
[junit4:junit4] 2> 20570 T1725 C238 P43388 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20571 T1725 C238 P43388 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20571 T1725 C238 P43388 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20572 T1725 C238 P43388 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20572 T1725 C238 P43388 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20572 T1725 C238 P43388 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:57179/idf/collection1/. core=collection1
[junit4:junit4] 2> 20572 T1725 C238 P43388 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C239 name=collection1 org.apache.solr.core.SolrCore@68f3c7ae url=http://127.0.0.1:57179/idf/collection1 node=127.0.0.1:57179_idf C239_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:57179_idf, base_url=http://127.0.0.1:57179/idf, leader=true}
[junit4:junit4] 2> 20579 T1681 C239 P57179 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 20591 T1682 C239 P57179 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 20593 T1682 C239 P57179 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45c8fad1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7eeb6440),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20593 T1682 C239 P57179 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20594 T1682 C239 P57179 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45c8fad1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7eeb6440),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45c8fad1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7eeb6440),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20594 T1682 C239 P57179 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20595 T1682 C239 P57179 oass.SolrIndexSearcher.<init> Opening Searcher@41f7dc64 realtime
[junit4:junit4] 2> 20595 T1682 C239 P57179 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20596 T1682 C239 P57179 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 20596 T1725 C238 P43388 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20597 T1725 C238 P43388 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20598 T1683 C239 P57179 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20599 T1683 C239 P57179 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 20599 T1725 C238 P43388 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 20599 T1725 C238 P43388 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20599 T1725 C238 P43388 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20602 T1683 C239 P57179 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 20602 T1725 C238 P43388 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20603 T1725 C238 P43388 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty3/index.20130315122726124 forceNew: false
[junit4:junit4] 2> 20604 T1725 C238 P43388 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@4e6fe801 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3eac2fd; maxCacheMB=0.826171875 maxMergeSizeMB=0.1025390625)) fullCopy=false
[junit4:junit4] 2> 20606 T1683 C239 P57179 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 20607 T1725 C238 P43388 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20608 T1725 C238 P43388 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20608 T1725 C238 P43388 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20661 T1725 C238 P43388 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5f9b82a7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@712d4990),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5f9b82a7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@712d4990),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20661 T1725 C238 P43388 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20662 T1725 C238 P43388 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20662 T1725 C238 P43388 oass.SolrIndexSearcher.<init> Opening Searcher@4142aef8 main
[junit4:junit4] 2> 20663 T1724 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4142aef8 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 20664 T1725 C238 P43388 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@4e6fe801 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3eac2fd; maxCacheMB=0.826171875 maxMergeSizeMB=0.1025390625))
[junit4:junit4] 2> 20664 T1725 C238 P43388 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20664 T1725 C238 P43388 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20664 T1725 C238 P43388 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20664 T1725 C238 P43388 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20671 T1725 C238 P43388 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20759 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20760 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57030_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57030/idf"}
[junit4:junit4] 2> 20760 T1671 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 20761 T1671 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 20765 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:43388_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43388/idf"}
[junit4:junit4] 2> 20777 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20777 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20777 T1739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20777 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20777 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20777 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21554 T1740 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 21554 T1740 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57030/idf collection:collection1 shard:shard2
[junit4:junit4] 2> 21557 T1740 oasc.ZkController.register We are http://127.0.0.1:57030/idf/collection1/ and leader is http://127.0.0.1:18313/idf/collection1/
[junit4:junit4] 2> 21557 T1740 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57030/idf
[junit4:junit4] 2> 21557 T1740 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 21558 T1740 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C240 name=collection1 org.apache.solr.core.SolrCore@1617f808 url=http://127.0.0.1:57030/idf/collection1 node=127.0.0.1:57030_idf C240_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:57030_idf, base_url=http://127.0.0.1:57030/idf}
[junit4:junit4] 2> 21558 T1744 C240 P57030 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 21559 T1744 C240 P57030 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 21559 T1740 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21559 T1744 C240 P57030 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 21560 T1744 C240 P57030 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 21560 T1648 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1
[junit4:junit4] 2> 21561 T1744 C240 P57030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21561 T1648 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 21562 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21573 T1648 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21575 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21586 T1684 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/onenodecollectioncore
[junit4:junit4] 2> 21586 T1684 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 21587 T1684 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 21587 T1684 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 21588 T1684 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 21589 T1684 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 21591 T1684 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 21593 T1684 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/onenodecollectioncore/'
[junit4:junit4] 2> 21656 T1684 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 21716 T1684 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 21817 T1684 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 21823 T1684 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 22292 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22292 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57030_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57030/idf"}
[junit4:junit4] 2> 22309 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22309 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22309 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22309 T1739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22309 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22309 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 22432 T1684 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 22439 T1684 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 22442 T1684 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 22454 T1684 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 22458 T1684 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 22461 T1684 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 22462 T1684 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 22462 T1684 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 22462 T1684 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 22463 T1684 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 22464 T1684 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 22464 T1684 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 22464 T1684 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1363332429392/onenodecollectioncore/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363332425525/onenodecollection/
[junit4:junit4] 2> 22464 T1684 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@962522b
[junit4:junit4] 2> 22465 T1684 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 22465 T1684 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363332425525/onenodecollection forceNew: false
[junit4:junit4] 2> 22466 T1684 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363332425525/onenodecollection/index/
[junit4:junit4] 2> 22466 T1684 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363332425525/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 22466 T1684 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363332425525/onenodecollection/index forceNew: false
[junit4:junit4] 2> 22468 T1684 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@40fd1595 lockFactory=org.apache.lucene.store.NativeFSLockFactory@683f7b04),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22469 T1684 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22470 T1684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 22471 T1684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 22471 T1684 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 22471 T1684 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 22472 T1684 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 22472 T1684 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 22472 T1684 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 22473 T1684 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 22473 T1684 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 22478 T1684 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 22482 T1684 oass.SolrIndexSearcher.<init> Opening Searcher@6431156b main
[junit4:junit4] 2> 22482 T1684 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363332425525/onenodecollection/tlog
[junit4:junit4] 2> 22483 T1684 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 22483 T1684 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 22485 T1746 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@6431156b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 22487 T1684 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 22574 T1696 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=5&state=recovering&nodeName=127.0.0.1:57030_idf&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 23815 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23815 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:57179_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57179/idf"}
[junit4:junit4] 2> 23816 T1671 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 23816 T1671 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 23857 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23858 T1739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23857 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23857 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23857 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23857 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 24490 T1684 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 24490 T1684 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:57179/idf collection:onenodecollection shard:shard1
[junit4:junit4] 2> 24491 T1684 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 24507 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0006 type:delete cxid:0xaa zxid:0xc5 txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 24507 T1684 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 24508 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0006 type:create cxid:0xab zxid:0xc6 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 24518 T1684 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 24518 T1684 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 24518 T1684 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57179/idf/onenodecollectioncore/
[junit4:junit4] 2> 24519 T1684 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 24519 T1684 oasc.SyncStrategy.syncToMe http://127.0.0.1:57179/idf/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 24519 T1684 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57179/idf/onenodecollectioncore/
[junit4:junit4] 2> 24519 T1684 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 24523 T1653 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d6cf1e73b0006 type:create cxid:0xb5 zxid:0xca txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> C240_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:57030_idf, base_url=http://127.0.0.1:57030/idf}
[junit4:junit4] 2> 24575 T1744 C240 P57030 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:18313/idf/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 24575 T1744 C240 P57030 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:57030/idf START replicas=[http://127.0.0.1:18313/idf/collection1/] nUpdates=100
[junit4:junit4] 2> 24575 T1744 C240 P57030 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 24575 T1744 C240 P57030 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 24576 T1744 C240 P57030 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 24576 T1744 C240 P57030 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 24576 T1744 C240 P57030 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 24577 T1744 C240 P57030 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:18313/idf/collection1/. core=collection1
[junit4:junit4] 2> 24577 T1744 C240 P57030 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C241 name=collection1 org.apache.solr.core.SolrCore@3b8569bf url=http://127.0.0.1:18313/idf/collection1 node=127.0.0.1:18313_idf C241_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:18313_idf, base_url=http://127.0.0.1:18313/idf, leader=true}
[junit4:junit4] 2> 24582 T1697 C241 P18313 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 24594 T1698 C241 P18313 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 24596 T1698 C241 P18313 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@46c101bf lockFactory=org.apache.lucene.store.NativeFSLockFactory@4510764a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 24596 T1698 C241 P18313 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 24597 T1698 C241 P18313 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@46c101bf lockFactory=org.apache.lucene.store.NativeFSLockFactory@4510764a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@46c101bf lockFactory=org.apache.lucene.store.NativeFSLockFactory@4510764a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24597 T1698 C241 P18313 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24598 T1698 C241 P18313 oass.SolrIndexSearcher.<init> Opening Searcher@39dcaf68 realtime
[junit4:junit4] 2> 24598 T1698 C241 P18313 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 24599 T1698 C241 P18313 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 24599 T1744 C240 P57030 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24599 T1744 C240 P57030 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 24601 T1699 C241 P18313 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 24601 T1699 C241 P18313 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 24601 T1744 C240 P57030 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 24602 T1744 C240 P57030 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 24602 T1744 C240 P57030 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 24604 T1699 C241 P18313 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 24604 T1744 C240 P57030 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 24605 T1744 C240 P57030 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4/index.20130315122730126 forceNew: false
[junit4:junit4] 2> 24605 T1744 C240 P57030 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2ae2f8dd lockFactory=org.apache.lucene.store.NativeFSLockFactory@46d3b20d; maxCacheMB=0.826171875 maxMergeSizeMB=0.1025390625)) fullCopy=false
[junit4:junit4] 2> 24608 T1699 C241 P18313 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 24609 T1744 C240 P57030 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 24609 T1744 C240 P57030 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 24610 T1744 C240 P57030 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 24662 T1744 C240 P57030 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@78ffcbf7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5d697666),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@78ffcbf7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5d697666),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 24662 T1744 C240 P57030 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 24662 T1744 C240 P57030 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 24662 T1744 C240 P57030 oass.SolrIndexSearcher.<init> Opening Searcher@69de18a1 main
[junit4:junit4] 2> 24663 T1741 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@69de18a1 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 24664 T1744 C240 P57030 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2ae2f8dd lockFactory=org.apache.lucene.store.NativeFSLockFactory@46d3b20d; maxCacheMB=0.826171875 maxMergeSizeMB=0.1025390625))
[junit4:junit4] 2> 24664 T1744 C240 P57030 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 24664 T1744 C240 P57030 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 24664 T1744 C240 P57030 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 24664 T1744 C240 P57030 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 24666 T1744 C240 P57030 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 25362 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25381 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57030_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57030/idf"}
[junit4:junit4] 2> 25393 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25393 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25393 T1739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25393 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25393 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25393 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25442 T1684 oasc.ZkController.register We are http://127.0.0.1:57179/idf/onenodecollectioncore/ and leader is http://127.0.0.1:57179/idf/onenodecollectioncore/
[junit4:junit4] 2> 25442 T1684 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:57179/idf
[junit4:junit4] 2> 25442 T1684 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 25443 T1684 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 25444 T1684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25445 T1684 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=1&roles=none&name=onenodecollectioncore&action=CREATE&collection=onenodecollection&dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build/solr-core/test/J1/./solrtest-BasicDistributedZk2Test-1363332425525/onenodecollection&wt=javabin&version=2} status=0 QTime=3859
[junit4:junit4] 2> 25446 T1648 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 25447 T1648 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26448 T1648 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26900 T1671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 26901 T1671 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:57179_idf_onenodecollectioncore",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:57179_idf",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57179/idf"}
[junit4:junit4] 2> 26921 T1690 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26921 T1739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26921 T1722 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26921 T1706 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26921 T1670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 26921 T1677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 27450 T1648 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27456 T1648 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 27457 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C242 name=onenodecollectioncore org.apache.solr.core.SolrCore@45b7003c url=http://127.0.0.1:57179/idf/onenodecollectioncore node=127.0.0.1:57179_idf C242_STATE=coll:onenodecollection core:onenodecollectioncore props:{shard=shard1, roles=none, state=active, core=onenodecollectioncore, collection=onenodecollection, node_name=127.0.0.1:57179_idf, base_url=http://127.0.0.1:57179/idf, leader=true}
[junit4:junit4] 2> 27487 T1685 C242 P57179 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@40fd1595 lockFactory=org.apache.lucene.store.NativeFSLockFactory@683f7b04),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 27488 T1685 C242 P57179 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 27492 T1685 C242 P57179 /update {wt=javabin&version=2} {add=[1 (1429557690243219456)]} 0 7
[junit4:junit4] 2> 27499 T1685 C242 P57179 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27504 T1685 C242 P57179 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@40fd1595 lockFactory=org.apache.lucene.store.NativeFSLockFactory@683f7b04),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@40fd1595 lockFactory=org.apache.lucene.store.NativeFSLockFactory@683f7b04),segFN=segments_2,generation=2,filenames=[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_Direct_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockVariableIntBlock_0.frq, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0_Direct_0.pos, _0_Direct_0.tip, _0.fdx, _0_Direct_0.tim, _0.fdt]
[junit4:junit4] 2> 27504 T1685 C242 P57179 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_Direct_0.doc, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_MockVariableIntBlock_0.frq, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0_Direct_0.pos, _0_Direct_0.tip, _0.fdx, _0_Direct_0.tim, _0.fdt]
[junit4:junit4] 2> 27554 T1685 C242 P57179 oass.SolrIndexSearcher.<init> Opening Searcher@5709cdc8 main
[junit4:junit4] 2> 27554 T1685 C242 P57179 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27555 T1746 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@5709cdc8 main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4] 2> 27556 T1685 C242 P57179 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 57
[junit4:junit4] 2> 27560 T1685 C242 P57179 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4:junit4] 2> 27561 T1648 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 27574 T1685 C242 P57179 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C243 name=collection1 org.apache.solr.core.SolrCore@13eef332 url=http://127.0.0.1:65311/idf/collection1 node=127.0.0.1:65311_idf C243_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:65311_idf, base_url=http://127.0.0.1:65311/idf, leader=true}
[junit4:junit4] 2> 27584 T1660 C243 P65311 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@496cff2a lockFactory=org.apache.lucene.store.NativeFSLockFactory@48303e79),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 27585 T1660 C243 P65311 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 27588 T1660 C243 P65311 /update {wt=javabin&version=2} {add=[1 (1429557690344931328)]} 0 6
[junit4:junit4] 2> C238_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:43388_idf, base_url=http://127.0.0.1:43388/idf}
[junit4:junit4] 2> 27611 T1712 C238 P43388 /update {distrib.from=http://127.0.0.1:57179/idf/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429557690362757120)]} 0 3
[junit4:junit4] 2> 27612 T1686 C239 P57179 /update {wt=javabin&version=2} {add=[1 (1429557690362757120)]} 0 13
[junit4:junit4] 2> 27614 T1660 C243 P65311 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27619 T1660 C243 P65311 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@496cff2a lockFactory=org.apache.lucene.store.NativeFSLockFactory@48303e79),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@496cff2a lockFactory=org.apache.lucene.store.NativeFSLockFactory@48303e79),segFN=segments_2,generation=2,filenames=[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_Direct_0.doc, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockVariableIntBlock_0.frq, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0_Direct_0.pos, _0_Direct_0.tip, _0.fdx, _0_Direct_0.tim, _0.fdt]
[junit4:junit4] 2> 27619 T1660 C243 P65311 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_Direct_0.doc, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockVariableIntBlock_0.frq, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0_Direct_0.pos, _0_Direct_0.tip, _0.fdx, _0_Direct_0.tim, _0.fdt]
[junit4:junit4] 2> 27621 T1660 C243 P65311 oass.SolrIndexSearcher.<init> Opening Searcher@47906e1d main
[junit4:junit4] 2> 27622 T1660 C243 P65311 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27623 T1674 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@47906e1d main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4] 2> 27623 T1660 C243 P65311 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 9
[junit4:junit4] 2> 27626 T1686 C239 P57179 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27630 T1686 C239 P57179 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45c8fad1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7eeb6440),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@45c8fad1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7eeb6440),segFN=segments_3,generation=3,filenames=[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_Direct_0.doc, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockVariableIntBlock_0.frq, _0_TestBloomFilteredLucene41Postings_0.doc, _0_Direct_0.pos, _0_Direct_0.tip, _0.fdx, _0_Direct_0.tim, _0.fdt, segments_3]
[junit4:junit4] 2> 27631 T1686 C239 P57179 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_Direct_0.doc, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockVariableIntBlock_0.frq, _0_TestBloomFilteredLucene41Postings_0.doc, _0_Direct_0.pos, _0_Direct_0.tip, _0.fdx, _0_Direct_0.tim, _0.fdt, segments_3]
[junit4:junit4] 2> 27633 T1686 C239 P57179 oass.SolrIndexSearcher.<init> Opening Searcher@3ec0e689 main
[junit4:junit4] 2> 27633 T1686 C239 P57179 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27634 T1692 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ec0e689 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 27634 T1686 C239 P57179 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:43388/idf/collection1/, StdNode: http://127.0.0.1:18313/idf/collection1/, StdNode: http://127.0.0.1:57030/idf/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 27636 T1702 C241 P18313 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27637 T1712 C238 P43388 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27637 T1702 C241 P18313 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@46c101bf lockFactory=org.apache.lucene.store.NativeFSLockFactory@4510764a),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@46c101bf lockFactory=org.apache.lucene.store.NativeFSLockFactory@4510764a),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 27638 T1702 C241 P18313 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 27638 T1702 C241 P18313 oass.SolrIndexSearcher.<init> Opening Searcher@47d7353b main
[junit4:junit4] 2> 27638 T1702 C241 P18313 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27639 T1708 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@47d7353b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 27639 T1702 C241 P18313 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 2> 27642 T1712 C238 P43388 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5f9b82a7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@712d4990),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5f9b82a7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@712d4990),segFN=segments_3,generation=3,filenames=[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_Direct_0.doc, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockVariableIntBlock_0.frq, _0_TestBloomFilteredLucene41Postings_0.doc, _0_Direct_0.pos, _0_Direct_0.tip, _0.fdx, _0_Direct_0.tim, _0.fdt, segments_3]
[junit4:junit4] 2> C240_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:57030_idf, base_url=http://127.0.0.1:57030/idf}
[junit4:junit4] 2> 27642 T1729 C240 P57030 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27642 T1712 C238 P43388 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_Direct_0.doc, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockVariableIntBlock_0.frq, _0_TestBloomFilteredLucene41Postings_0.doc, _0_Direct_0.pos, _0_Direct_0.tip, _0.fdx, _0_Direct_0.tim, _0.fdt, segments_3]
[junit4:junit4] 2> 27643 T1729 C240 P57030 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@78ffcbf7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5d697666),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@78ffcbf7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5d697666),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 27643 T1729 C240 P57030 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 27644 T1729 C240 P57030 oass.SolrIndexSearcher.<init> Opening Searcher@63b3c0be main
[junit4:junit4] 2> 27644 T1729 C240 P57030 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27645 T1741 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@63b3c0be main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 27645 T1729 C240 P57030 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 2> 27695 T1712 C238 P43388 oass.SolrIndexSearcher.<init> Opening Searcher@7eac872f main
[junit4:junit4] 2> 27696 T1712 C238 P43388 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27697 T1724 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7eac872f main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 27697 T1712 C238 P43388 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 60
[junit4:junit4] 2> 27698 T1686 C239 P57179 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 72
[junit4:junit4] 2> 27698 T1648 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 27699 T1648 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27700 T1648 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 27703 T1660 C243 P65311 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 27704 T1648 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:47880/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@70df5fa1
[junit4:junit4] 2> 27705 T1648 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 27706 T1753 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:47880. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 27706 T1753 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:47880, initiating session
[junit4:junit4] 2> 27706 T1650 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:32138
[junit4:junit4] 2> 27707 T1650 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:32138
[junit4:junit4] 2> 27708 T1652 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d6cf1e73b000d with negotiated timeout 10000 for client /140.211.11.196:32138
[junit4:junit4] 2> 27708 T1753 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:47880, sessionid = 0x13d6cf1e73b000d, negotiated timeout = 10000
[junit4:junit4] 2> 27709 T1
[...truncated too long message...]
esById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 155822 T1739 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 155822 T1739 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 155823 T1739 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 155826 T1739 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 155827 T1739 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4/index.20130315122730126
[junit4:junit4] 2> 155827 T1739 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4/index.20130315122730126
[junit4:junit4] 2> 155827 T1739 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4
[junit4:junit4] 2> 155827 T1739 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4
[junit4:junit4] 2> 155828 T1739 oasc.CachingDirectoryFactory.close Closing directory when closing factory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4/index
[junit4:junit4] 2> 155828 T1739 oasc.CachingDirectoryFactory.closeDirectory Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1363332425525/jetty4/index
[junit4:junit4] 2> 155828 T1739 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 155829 T1739 oasc.LeaderElector$1.process WARNING org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89347353839599628-5-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:246)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 155830 T1739 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 155830 T1739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 155830 T1739 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 155830 T1739 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 155831 T1739 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 155831 T1739 oasc.LeaderElector$1.process WARNING org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 155832 T1739 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {foo_b=PostingsFormat(name=Direct), n_f1=MockVariableIntBlock(baseBlockSize=41), foo_d=Pulsing41(freqCutoff=1 minBlockSize=41 maxBlockSize=111), foo_f=PostingsFormat(name=Direct), n_tl1=MockVariableIntBlock(baseBlockSize=41), n_d1=PostingsFormat(name=TestBloomFilteredLucene41Postings), rnd_b=Pulsing41(freqCutoff=1 minBlockSize=41 maxBlockSize=111), intDefault=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_td1=MockVariableIntBlock(baseBlockSize=41), timestamp=PostingsFormat(name=TestBloomFilteredLucene41Postings), id=Pulsing41(freqCutoff=1 minBlockSize=41 maxBlockSize=111), range_facet_sl=PostingsFormat(name=Direct), range_facet_si=MockVariableIntBlock(baseBlockSize=41), oddField_s=PostingsFormat(name=Direct), multiDefault=MockVariableIntBlock(baseBlockSize=41), n_tf1=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_dt1=MockVariableIntBlock(baseBlockSize=41), range_facet_l=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_ti1=Pulsing41(freqCutoff=1 minBlockSize=41 maxBlockSize=111), text=PostingsFormat(name=Direct), _version_=PostingsFormat(name=TestBloomFilteredLucene41Postings), SubjectTerms_mfacet=PostingsFormat(name=TestBloomFilteredLucene41Postings), a_t=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_tdt1=PostingsFormat(name=TestBloomFilteredLucene41Postings), other_tl1=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_l1=PostingsFormat(name=TestBloomFilteredLucene41Postings), a_si=MockVariableIntBlock(baseBlockSize=41)}, docValues:{timestamp=DocValuesFormat(name=Disk)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=is, timezone=Asia/Ashgabat
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=2,free=89818736,total=393805824
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestRangeQuery, TestFiltering, OpenCloseCoreStressTest, TestMultiCoreConfBootstrap, ChaosMonkeySafeLeaderTest, TestUtils, TestLMJelinekMercerSimilarityFactory, SolrCoreCheckLockOnStartupTest, UpdateParamsTest, StandardRequestHandlerTest, TestDistributedSearch, JSONWriterTest, TestDFRSimilarityFactory, TestBinaryField, TestBinaryResponseWriter, TestNumberUtils, ShardRoutingCustomTest, SolrRequestParserTest, MultiTermTest, PathHierarchyTokenizerFactoryTest, BadIndexSchemaTest, TestFoldingMultitermQuery, TestRTGBase, SolrCmdDistributorTest, TestLuceneMatchVersion, TestAnalyzedSuggestions, SuggesterTSTTest, DirectUpdateHandlerTest, TestPartialUpdateDeduplication, OpenExchangeRatesOrgProviderTest, CollectionsAPIDistributedZkTest, DocumentAnalysisRequestHandlerTest, HighlighterTest, UniqFieldsUpdateProcessorFactoryTest, TestStressReorder, TestDynamicFieldCollectionResource, TestQueryTypes, IndexBasedSpellCheckerTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J1 in 156.85s, 1 test, 1 error <<< FAILURES!
[...truncated 515 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-Java6/lucene/common-build.xml:877: There were test failures: 272 suites, 1144 tests, 1 error, 27 ignored (8 assumptions)
Total time: 53 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure