You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/03/20 06:24:12 UTC
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1084 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1084/
3 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:24942/collection1lastClient and got 5 from http://127.0.0.1:29568/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:24942/collection1lastClient and got 5 from http://127.0.0.1:29568/collection1
at __randomizedtesting.SeedInfo.seed([EB01698C28D66809:6AE7E7945F890835]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:233)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.core.TestSolrDiscoveryProperties.testPropertiesFile
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([EB01698C28D66809]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestSolrDiscoveryProperties
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([EB01698C28D66809]:0)
Build Log:
[...truncated 9382 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 0 T1974 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 5 T1974 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1363748640873
[junit4:junit4] 2> 7 T1974 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 7 T1975 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 11 T1975 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 11 T1975 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 12 T1975 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 12 T1975 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 13 T1975 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1363748640873/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 108 T1974 oasc.ZkTestServer.run start zk server on port:53260
[junit4:junit4] 2> 130 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@b3a27b9
[junit4:junit4] 2> 132 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 132 T1980 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 133 T1980 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 133 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53373
[junit4:junit4] 2> 134 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53373
[junit4:junit4] 2> 134 T1978 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 138 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d8710000 with negotiated timeout 10000 for client /140.211.11.196:53373
[junit4:junit4] 2> 138 T1980 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d8710000, negotiated timeout = 10000
[junit4:junit4] 2> 139 T1981 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b3a27b9 name:ZooKeeperConnection Watcher:127.0.0.1:53260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 139 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 139 T1974 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 208 T1979 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85c0d8710000
[junit4:junit4] 2> 210 T1981 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 211 T1976 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:53373 which had sessionid 0x13d85c0d8710000
[junit4:junit4] 2> 210 T1974 oaz.ZooKeeper.close Session: 0x13d85c0d8710000 closed
[junit4:junit4] 2> 211 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@69e69a77
[junit4:junit4] 2> 212 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 213 T1982 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 213 T1982 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 213 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:21981
[junit4:junit4] 2> 214 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:21981
[junit4:junit4] 2> 429 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d8710001 with negotiated timeout 10000 for client /140.211.11.196:21981
[junit4:junit4] 2> 429 T1982 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d8710001, negotiated timeout = 10000
[junit4:junit4] 2> 430 T1983 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69e69a77 name:ZooKeeperConnection Watcher:127.0.0.1:53260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 430 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 431 T1974 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 489 T1974 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 502 T1974 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 511 T1974 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 514 T1974 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 515 T1974 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 638 T1974 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 639 T1974 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 747 T1974 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 748 T1974 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 752 T1974 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 753 T1974 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 806 T1974 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 807 T1974 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 814 T1974 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 814 T1974 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 833 T1974 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 834 T1974 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 839 T1974 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 840 T1974 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 843 T1974 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 847 T1974 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 907 T1979 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85c0d8710001
[junit4:junit4] 2> 924 T1976 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:21981 which had sessionid 0x13d85c0d8710001
[junit4:junit4] 2> 924 T1983 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 924 T1974 oaz.ZooKeeper.close Session: 0x13d85c0d8710001 closed
[junit4:junit4] 2> 1127 T1974 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 1131 T1974 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:60566
[junit4:junit4] 2> 1132 T1974 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1133 T1974 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1133 T1974 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363748641792
[junit4:junit4] 2> 1134 T1974 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363748641792/solr.xml
[junit4:junit4] 2> 1135 T1974 oasc.CoreContainer.<init> New CoreContainer 1052636555
[junit4:junit4] 2> 1136 T1974 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363748641792/'
[junit4:junit4] 2> 1136 T1974 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363748641792/'
[junit4:junit4] 2> 1204 T1974 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1205 T1974 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1205 T1974 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1206 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1206 T1974 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1207 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1208 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1208 T1974 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1209 T1974 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1209 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1233 T1974 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 1256 T1974 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53260/solr
[junit4:junit4] 2> 1257 T1974 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1257 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3a70e6c1
[junit4:junit4] 2> 1259 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1259 T1993 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1264 T1993 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 1264 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59346
[junit4:junit4] 2> 1265 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59346
[junit4:junit4] 2> 1303 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d8710002 with negotiated timeout 20000 for client /140.211.11.196:59346
[junit4:junit4] 2> 1303 T1993 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d8710002, negotiated timeout = 20000
[junit4:junit4] 2> 1304 T1994 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a70e6c1 name:ZooKeeperConnection Watcher:127.0.0.1:53260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1305 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1308 T1979 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85c0d8710002
[junit4:junit4] 2> 1461 T1994 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 1461 T1976 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:59346 which had sessionid 0x13d85c0d8710002
[junit4:junit4] 2> 1461 T1974 oaz.ZooKeeper.close Session: 0x13d85c0d8710002 closed
[junit4:junit4] 2> 1462 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1475 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@54a4c123
[junit4:junit4] 2> 1476 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1476 T1995 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 1477 T1995 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 1477 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64152
[junit4:junit4] 2> 1478 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64152
[junit4:junit4] 2> 1480 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d8710003 with negotiated timeout 20000 for client /140.211.11.196:64152
[junit4:junit4] 2> 1480 T1995 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d8710003, negotiated timeout = 20000
[junit4:junit4] 2> 1481 T1996 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54a4c123 name:ZooKeeperConnection Watcher:127.0.0.1:53260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1481 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1484 T1974 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1528 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1531 T1974 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1546 T1974 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1549 T1974 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60566_
[junit4:junit4] 2> 1549 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:60566_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:60566_
[junit4:junit4] 2> 1589 T1974 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60566_
[junit4:junit4] 2> 1598 T1974 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1632 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 1633 T1974 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1645 T1974 oasc.Overseer.start Overseer (id=89374630928777219-127.0.0.1:60566_-n_0000000000) starting
[junit4:junit4] 2> 1646 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1648 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1664 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1666 T1974 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1690 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 1693 T1998 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1695 T1974 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1730 T1974 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1736 T1974 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1739 T1997 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1743 T1999 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363748641792/collection1
[junit4:junit4] 2> 1744 T1999 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1744 T1999 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1744 T1999 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1746 T1999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363748641792/collection1/'
[junit4:junit4] 2> 1747 T1999 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363748641792/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1748 T1999 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1363748641792/collection1/lib/README' to classloader
[junit4:junit4] 2> 1801 T1999 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 1865 T1999 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1966 T1999 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1973 T1999 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 2667 T1999 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 2679 T1999 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 2684 T1999 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 2700 T1999 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2705 T1999 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 2711 T1999 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2712 T1999 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2712 T1999 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 2713 T1999 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 2714 T1999 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 2714 T1999 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 2714 T1999 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 2715 T1999 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363748641792/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data/
[junit4:junit4] 2> 2715 T1999 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e392ce0
[junit4:junit4] 2> 2716 T1999 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 2717 T1999 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data forceNew: false
[junit4:junit4] 2> 2717 T1999 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data/index/
[junit4:junit4] 2> 2718 T1999 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 2719 T1999 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data/index forceNew: false
[junit4:junit4] 2> 2737 T1999 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@657a2ad6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 2738 T1999 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 2742 T1999 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 2742 T1999 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 2743 T1999 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 2744 T1999 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 2745 T1999 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 2745 T1999 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 2745 T1999 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 2746 T1999 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 2747 T1999 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 2777 T1999 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 2785 T1999 oass.SolrIndexSearcher.<init> Opening Searcher@73f7dd52 main
[junit4:junit4] 2> 2787 T1999 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 2787 T1999 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 2791 T2000 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@73f7dd52 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 2792 T1999 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 2793 T1999 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3243 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3244 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:60566_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60566"}
[junit4:junit4] 2> 3244 T1997 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 3244 T1997 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 3263 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3799 T1999 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 3799 T1999 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60566 collection:control_collection shard:shard1
[junit4:junit4] 2> 3800 T1999 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 3842 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 3854 T1999 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 3855 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3902 T1999 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 3902 T1999 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 3902 T1999 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60566/collection1/
[junit4:junit4] 2> 3903 T1999 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 3903 T1999 oasc.SyncStrategy.syncToMe http://127.0.0.1:60566/collection1/ has no replicas
[junit4:junit4] 2> 3903 T1999 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60566/collection1/
[junit4:junit4] 2> 3903 T1999 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 3925 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4781 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4829 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4858 T1999 oasc.ZkController.register We are http://127.0.0.1:60566/collection1/ and leader is http://127.0.0.1:60566/collection1/
[junit4:junit4] 2> 4858 T1999 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60566
[junit4:junit4] 2> 4858 T1999 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 4859 T1999 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 4859 T1999 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 4864 T1999 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4865 T1974 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 4866 T1974 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4866 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4883 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 4884 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@14446305
[junit4:junit4] 2> 4885 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4885 T2002 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4886 T2002 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 4886 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64546
[junit4:junit4] 2> 4887 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64546
[junit4:junit4] 2> 4890 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d8710004 with negotiated timeout 10000 for client /140.211.11.196:64546
[junit4:junit4] 2> 4890 T2002 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d8710004, negotiated timeout = 10000
[junit4:junit4] 2> 4890 T2003 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14446305 name:ZooKeeperConnection Watcher:127.0.0.1:53260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4891 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4893 T1974 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4896 T1974 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 5168 T1974 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 5171 T1974 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51152
[junit4:junit4] 2> 5172 T1974 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 5173 T1974 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 5173 T1974 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363748645763
[junit4:junit4] 2> 5174 T1974 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363748645763/solr.xml
[junit4:junit4] 2> 5174 T1974 oasc.CoreContainer.<init> New CoreContainer 1513164375
[junit4:junit4] 2> 5175 T1974 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363748645763/'
[junit4:junit4] 2> 5176 T1974 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363748645763/'
[junit4:junit4] 2> 5243 T1974 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 5244 T1974 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 5245 T1974 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 5245 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 5246 T1974 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 5247 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 5247 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 5248 T1974 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 5249 T1974 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 5249 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 5286 T1974 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 5319 T1974 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53260/solr
[junit4:junit4] 2> 5320 T1974 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 5320 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@2d16b30
[junit4:junit4] 2> 5322 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5322 T2013 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5324 T2013 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 5324 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:59508
[junit4:junit4] 2> 5324 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:59508
[junit4:junit4] 2> 5397 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d8710005 with negotiated timeout 20000 for client /140.211.11.196:59508
[junit4:junit4] 2> 5397 T2013 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d8710005, negotiated timeout = 20000
[junit4:junit4] 2> 5398 T2014 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d16b30 name:ZooKeeperConnection Watcher:127.0.0.1:53260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5398 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5401 T1979 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85c0d8710005
[junit4:junit4] 2> 5419 T2014 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 5420 T1976 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:59508 which had sessionid 0x13d85c0d8710005
[junit4:junit4] 2> 5419 T1974 oaz.ZooKeeper.close Session: 0x13d85c0d8710005 closed
[junit4:junit4] 2> 5421 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 5434 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@16d77794
[junit4:junit4] 2> 5435 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 5436 T2015 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 5436 T2015 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 5437 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:17170
[junit4:junit4] 2> 5437 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:17170
[junit4:junit4] 2> 5439 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d8710006 with negotiated timeout 20000 for client /140.211.11.196:17170
[junit4:junit4] 2> 5439 T2015 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d8710006, negotiated timeout = 20000
[junit4:junit4] 2> 5440 T2016 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16d77794 name:ZooKeeperConnection Watcher:127.0.0.1:53260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 5440 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 5442 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5460 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5463 T1974 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 6368 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6369 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:60566_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60566"}
[junit4:junit4] 2> 6468 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 6468 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 6468 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 6469 T1974 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51152_
[junit4:junit4] 2> 6471 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710006 type:delete cxid:0xe zxid:0x4e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51152_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51152_
[junit4:junit4] 2> 6487 T1974 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51152_
[junit4:junit4] 2> 6601 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 6602 T2016 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 6602 T2003 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 6602 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6602 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6603 T1996 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 6632 T2017 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363748645763/collection1
[junit4:junit4] 2> 6632 T2017 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 6633 T2017 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 6633 T2017 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 6635 T2017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363748645763/collection1/'
[junit4:junit4] 2> 6636 T2017 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363748645763/collection1/lib/README' to classloader
[junit4:junit4] 2> 6637 T2017 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1363748645763/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 6734 T2017 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 6799 T2017 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 6900 T2017 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 6908 T2017 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 7919 T2017 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 7935 T2017 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 7981 T2017 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 7998 T2017 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8021 T2017 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8027 T2017 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8028 T2017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8029 T2017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8030 T2017 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8031 T2017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8031 T2017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8032 T2017 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 8032 T2017 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363748645763/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/
[junit4:junit4] 2> 8032 T2017 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e392ce0
[junit4:junit4] 2> 8033 T2017 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 8034 T2017 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1 forceNew: false
[junit4:junit4] 2> 8035 T2017 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index/
[junit4:junit4] 2> 8036 T2017 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 8037 T2017 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index forceNew: false
[junit4:junit4] 2> 8104 T2017 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 8104 T2017 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 8109 T2017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 8110 T2017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 8111 T2017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 8112 T2017 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 8112 T2017 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 8112 T2017 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 8113 T2017 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 8114 T2017 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 8114 T2017 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 8132 T2017 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 8160 T2017 oass.SolrIndexSearcher.<init> Opening Searcher@1cc9ae3a main
[junit4:junit4] 2> 8162 T2017 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 8162 T2017 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 8169 T2018 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1cc9ae3a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 8171 T2017 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 8172 T2017 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 9493 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9494 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51152_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51152"}
[junit4:junit4] 2> 9494 T1997 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 9495 T1997 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 9597 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9597 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9597 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10179 T2017 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 10179 T2017 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51152 collection:collection1 shard:shard1
[junit4:junit4] 2> 10180 T2017 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 10238 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710006 type:delete cxid:0x4c zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 10240 T2017 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 10240 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710006 type:create cxid:0x4d zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10316 T2017 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 10317 T2017 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 10317 T2017 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51152/collection1/
[junit4:junit4] 2> 10317 T2017 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 10317 T2017 oasc.SyncStrategy.syncToMe http://127.0.0.1:51152/collection1/ has no replicas
[junit4:junit4] 2> 10318 T2017 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51152/collection1/
[junit4:junit4] 2> 10318 T2017 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 10382 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710006 type:create cxid:0x58 zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11140 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11593 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 11593 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 11593 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 11725 T2017 oasc.ZkController.register We are http://127.0.0.1:51152/collection1/ and leader is http://127.0.0.1:51152/collection1/
[junit4:junit4] 2> 11725 T2017 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51152
[junit4:junit4] 2> 11725 T2017 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 11726 T2017 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 11726 T2017 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11802 T2017 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11804 T1974 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 11804 T1974 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 11805 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12194 T1974 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12197 T1974 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51885
[junit4:junit4] 2> 12198 T1974 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12199 T1974 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12199 T1974 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363748652687
[junit4:junit4] 2> 12200 T1974 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363748652687/solr.xml
[junit4:junit4] 2> 12200 T1974 oasc.CoreContainer.<init> New CoreContainer 496841405
[junit4:junit4] 2> 12201 T1974 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363748652687/'
[junit4:junit4] 2> 12202 T1974 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363748652687/'
[junit4:junit4] 2> 12332 T1974 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12333 T1974 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12334 T1974 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12335 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12335 T1974 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12336 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12337 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12337 T1974 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12338 T1974 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12339 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12369 T1974 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12391 T1974 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53260/solr
[junit4:junit4] 2> 12392 T1974 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12393 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@26e46f80
[junit4:junit4] 2> 12394 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12394 T2029 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12395 T2029 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 12395 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48594
[junit4:junit4] 2> 12396 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48594
[junit4:junit4] 2> 12399 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d8710007 with negotiated timeout 20000 for client /140.211.11.196:48594
[junit4:junit4] 2> 12399 T2029 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d8710007, negotiated timeout = 20000
[junit4:junit4] 2> 12399 T2030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26e46f80 name:ZooKeeperConnection Watcher:127.0.0.1:53260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12400 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12402 T1979 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85c0d8710007
[junit4:junit4] 2> 12408 T2030 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12408 T1976 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:48594 which had sessionid 0x13d85c0d8710007
[junit4:junit4] 2> 12408 T1974 oaz.ZooKeeper.close Session: 0x13d85c0d8710007 closed
[junit4:junit4] 2> 12409 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12420 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@76956df1
[junit4:junit4] 2> 12422 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12422 T2031 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12423 T2031 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 12423 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22524
[junit4:junit4] 2> 12423 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22524
[junit4:junit4] 2> 12425 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d8710008 with negotiated timeout 20000 for client /140.211.11.196:22524
[junit4:junit4] 2> 12425 T2031 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d8710008, negotiated timeout = 20000
[junit4:junit4] 2> 12425 T2032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76956df1 name:ZooKeeperConnection Watcher:127.0.0.1:53260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12426 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12427 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12429 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710008 type:create cxid:0x3 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12452 T1974 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 13305 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13306 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51152_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51152"}
[junit4:junit4] 2> 13316 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 13316 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 13316 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 13316 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 13456 T1974 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51885_
[junit4:junit4] 2> 13457 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d8710008 type:delete cxid:0xf zxid:0x72 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51885_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51885_
[junit4:junit4] 2> 13462 T1974 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51885_
[junit4:junit4] 2> 13468 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 13468 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 13469 T2016 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 13469 T2003 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 13469 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13469 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13470 T1996 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 13470 T2032 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 13503 T2033 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363748652687/collection1
[junit4:junit4] 2> 13504 T2033 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13505 T2033 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13505 T2033 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13506 T2033 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363748652687/collection1/'
[junit4:junit4] 2> 13507 T2033 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363748652687/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13508 T2033 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1363748652687/collection1/lib/README' to classloader
[junit4:junit4] 2> 13545 T2033 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 13622 T2033 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13723 T2033 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13728 T2033 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 14333 T2033 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14344 T2033 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14368 T2033 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14382 T2033 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14386 T2033 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14391 T2033 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14392 T2033 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14392 T2033 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14392 T2033 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14393 T2033 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14394 T2033 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14394 T2033 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 14394 T2033 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363748652687/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/
[junit4:junit4] 2> 14395 T2033 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e392ce0
[junit4:junit4] 2> 14395 T2033 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 14396 T2033 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2 forceNew: false
[junit4:junit4] 2> 14396 T2033 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index/
[junit4:junit4] 2> 14397 T2033 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14397 T2033 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index forceNew: false
[junit4:junit4] 2> 14444 T2033 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@720116b6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14444 T2033 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14447 T2033 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14447 T2033 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14448 T2033 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14448 T2033 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14449 T2033 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14449 T2033 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14449 T2033 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14450 T2033 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14450 T2033 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14477 T2033 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14483 T2033 oass.SolrIndexSearcher.<init> Opening Searcher@430e68ee main
[junit4:junit4] 2> 14484 T2033 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14484 T2033 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14488 T2034 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@430e68ee main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14489 T2033 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14490 T2033 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14829 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14830 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51885_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51885"}
[junit4:junit4] 2> 14831 T1997 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 14831 T1997 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 14908 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14908 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14908 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14908 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15493 T2033 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 15493 T2033 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51885 collection:collection1 shard:shard1
[junit4:junit4] 2> 15496 T2033 oasc.ZkController.register We are http://127.0.0.1:51885/collection1/ and leader is http://127.0.0.1:51152/collection1/
[junit4:junit4] 2> 15497 T2033 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51885
[junit4:junit4] 2> 15497 T2033 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 15497 T2033 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C91 name=collection1 org.apache.solr.core.SolrCore@118cedce url=http://127.0.0.1:51885/collection1 node=127.0.0.1:51885_ C91_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:51885_, base_url=http://127.0.0.1:51885}
[junit4:junit4] 2> 15498 T2035 C91 P51885 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 15498 T2035 C91 P51885 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 15498 T2033 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15499 T2035 C91 P51885 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 15499 T2035 C91 P51885 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15499 T1974 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 15500 T1974 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 15500 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15535 T2035 C91 P51885 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15683 T1974 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 15685 T1974 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:24942
[junit4:junit4] 2> 15686 T1974 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 15686 T1974 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 15687 T1974 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363748656378
[junit4:junit4] 2> 15687 T1974 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363748656378/solr.xml
[junit4:junit4] 2> 15687 T1974 oasc.CoreContainer.<init> New CoreContainer 1273692418
[junit4:junit4] 2> 15688 T1974 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363748656378/'
[junit4:junit4] 2> 15688 T1974 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363748656378/'
[junit4:junit4] 2> 15733 T1974 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 15734 T1974 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 15734 T1974 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 15735 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 15735 T1974 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 15735 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 15736 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 15736 T1974 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 15736 T1974 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 15737 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 15753 T1974 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 15768 T1974 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53260/solr
[junit4:junit4] 2> 15769 T1974 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 15769 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@61f6247e
[junit4:junit4] 2> 15770 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 15771 T2046 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 15772 T2046 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 15772 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28976
[junit4:junit4] 2> 15772 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28976
[junit4:junit4] 2> 15775 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d8710009 with negotiated timeout 20000 for client /140.211.11.196:28976
[junit4:junit4] 2> 15775 T2046 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d8710009, negotiated timeout = 20000
[junit4:junit4] 2> 15775 T2047 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61f6247e name:ZooKeeperConnection Watcher:127.0.0.1:53260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 15776 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 15777 T1979 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85c0d8710009
[junit4:junit4] 2> 15800 T1976 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:28976 which had sessionid 0x13d85c0d8710009
[junit4:junit4] 2> 15800 T2047 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 15800 T1974 oaz.ZooKeeper.close Session: 0x13d85c0d8710009 closed
[junit4:junit4] 2> 15801 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 15813 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2059e229
[junit4:junit4] 2> 15814 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 15814 T2048 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 15815 T2048 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 15815 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:20281
[junit4:junit4] 2> 15815 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:20281
[junit4:junit4] 2> 15820 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d871000a with negotiated timeout 20000 for client /140.211.11.196:20281
[junit4:junit4] 2> 15820 T2048 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d871000a, negotiated timeout = 20000
[junit4:junit4] 2> 15820 T2049 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2059e229 name:ZooKeeperConnection Watcher:127.0.0.1:53260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 15821 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 15822 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d871000a type:create cxid:0x1 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 15845 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d871000a type:create cxid:0x3 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 15849 T1974 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 16414 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16415 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51885_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51885"}
[junit4:junit4] 2> 16821 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16821 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16821 T2049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16821 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16821 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16852 T1974 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:24942_
[junit4:junit4] 2> 16853 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d871000a type:delete cxid:0xf zxid:0x85 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:24942_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:24942_
[junit4:junit4] 2> 16856 T1974 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:24942_
[junit4:junit4] 2> 16876 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16876 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16877 T2049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 16877 T2016 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 16877 T2003 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 16878 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16878 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16878 T1996 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 16879 T2032 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 16885 T2049 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 16894 T2050 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363748656378/collection1
[junit4:junit4] 2> 16894 T2050 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 16895 T2050 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 16895 T2050 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 16896 T2050 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363748656378/collection1/'
[junit4:junit4] 2> 16897 T2050 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363748656378/collection1/lib/README' to classloader
[junit4:junit4] 2> 16897 T2050 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1363748656378/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 16941 T2050 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 17017 T2050 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 17118 T2050 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 17136 T2050 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17548 T2006 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=3&state=recovering&nodeName=127.0.0.1:51885_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 18197 T2050 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 18210 T2050 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 18215 T2050 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 18231 T2050 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 18237 T2050 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 18243 T2050 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 18245 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 18245 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 18246 T2050 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 18247 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 18247 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 18248 T2050 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 18248 T2050 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363748656378/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/
[junit4:junit4] 2> 18248 T2050 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e392ce0
[junit4:junit4] 2> 18249 T2050 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 18250 T2050 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3 forceNew: false
[junit4:junit4] 2> 18250 T2050 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/index/
[junit4:junit4] 2> 18251 T2050 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 18252 T2050 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/index forceNew: false
[junit4:junit4] 2> 18266 T2050 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@25aab21c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 18267 T2050 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 18271 T2050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 18271 T2050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 18272 T2050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 18273 T2050 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 18273 T2050 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 18274 T2050 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 18274 T2050 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 18275 T2050 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 18276 T2050 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 18292 T2050 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 18304 T2050 oass.SolrIndexSearcher.<init> Opening Searcher@148c4640 main
[junit4:junit4] 2> 18305 T2050 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 18306 T2050 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 18311 T2051 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@148c4640 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 18314 T2050 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 18314 T2050 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18348 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18349 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:24942_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:24942"}
[junit4:junit4] 2> 18349 T1997 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 18349 T1997 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 18388 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18388 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18388 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18388 T2049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18388 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19320 T2050 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 19320 T2050 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:24942 collection:collection1 shard:shard1
[junit4:junit4] 2> 19324 T2050 oasc.ZkController.register We are http://127.0.0.1:24942/collection1/ and leader is http://127.0.0.1:51152/collection1/
[junit4:junit4] 2> 19324 T2050 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:24942
[junit4:junit4] 2> 19325 T2050 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 19325 T2050 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C92 name=collection1 org.apache.solr.core.SolrCore@6376d552 url=http://127.0.0.1:24942/collection1 node=127.0.0.1:24942_ C92_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:24942_, base_url=http://127.0.0.1:24942}
[junit4:junit4] 2> 19325 T2052 C92 P24942 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 19326 T2050 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19326 T2052 C92 P24942 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 19327 T2052 C92 P24942 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 19327 T2052 C92 P24942 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19328 T1974 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 19329 T2052 C92 P24942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19329 T1974 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 19330 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> C91_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51885_, base_url=http://127.0.0.1:51885}
[junit4:junit4] 2> 19550 T2035 C91 P51885 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51152/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 19550 T2035 C91 P51885 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51885 START replicas=[http://127.0.0.1:51152/collection1/] nUpdates=100
[junit4:junit4] 2> 19551 T2035 C91 P51885 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 19551 T2035 C91 P51885 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 19551 T2035 C91 P51885 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 19552 T2035 C91 P51885 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 19552 T2035 C91 P51885 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 19552 T2035 C91 P51885 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51152/collection1/. core=collection1
[junit4:junit4] 2> 19552 T2035 C91 P51885 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C93 name=collection1 org.apache.solr.core.SolrCore@5add32be url=http://127.0.0.1:51152/collection1 node=127.0.0.1:51152_ C93_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51152_, base_url=http://127.0.0.1:51152, leader=true}
[junit4:junit4] 2> 19565 T2008 C93 P51152 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 19573 T2009 C93 P51152 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 19578 T2009 C93 P51152 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19579 T2009 C93 P51152 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19599 T1974 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 19602 T1974 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:29568
[junit4:junit4] 2> 19602 T1974 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 19603 T1974 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 19603 T1974 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363748660229
[junit4:junit4] 2> 19604 T1974 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363748660229/solr.xml
[junit4:junit4] 2> 19604 T1974 oasc.CoreContainer.<init> New CoreContainer 1552523809
[junit4:junit4] 2> 19605 T1974 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363748660229/'
[junit4:junit4] 2> 19606 T1974 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363748660229/'
[junit4:junit4] 2> 19669 T1974 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 19670 T1974 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 19671 T1974 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 19671 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 19672 T1974 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 19672 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 19673 T1974 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 19673 T1974 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 19674 T1974 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 19674 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 19720 T1974 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 19777 T1974 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:53260/solr
[junit4:junit4] 2> 19777 T1974 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 19778 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@69e9c8af
[junit4:junit4] 2> 19779 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 19780 T2064 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 19780 T2064 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 19781 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:35652
[junit4:junit4] 2> 19781 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:35652
[junit4:junit4] 2> 20149 T2009 C93 P51152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20150 T2009 C93 P51152 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20152 T2009 C93 P51152 oass.SolrIndexSearcher.<init> Opening Searcher@3416f291 realtime
[junit4:junit4] 2> 20152 T2009 C93 P51152 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20152 T2009 C93 P51152 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 579
[junit4:junit4] 2> 20154 T2035 C91 P51885 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20154 T2035 C91 P51885 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20156 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d871000b with negotiated timeout 20000 for client /140.211.11.196:35652
[junit4:junit4] 2> 20156 T2064 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d871000b, negotiated timeout = 20000
[junit4:junit4] 2> 20156 T2065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69e9c8af name:ZooKeeperConnection Watcher:127.0.0.1:53260 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 20158 T2010 C93 P51152 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20157 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 20158 T2010 C93 P51152 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 20160 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20161 T2035 C91 P51885 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 20161 T1979 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d85c0d871000b
[junit4:junit4] 2> 20161 T2035 C91 P51885 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20161 T2035 C91 P51885 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20165 T2010 C93 P51152 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 20166 T2035 C91 P51885 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20168 T2035 C91 P51885 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index.20130319220421034 forceNew: false
[junit4:junit4] 2> 20175 T2035 C91 P51885 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index.20130319220421034 lockFactory=org.apache.lucene.store.NativeFSLockFactory@234c9868; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 20180 T2010 C93 P51152 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4:junit4] 2> 20182 T2035 C91 P51885 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20203 T2065 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 20203 T1976 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:35652 which had sessionid 0x13d85c0d871000b
[junit4:junit4] 2> 20203 T1974 oaz.ZooKeeper.close Session: 0x13d85c0d871000b closed
[junit4:junit4] 2> 20203 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:24942_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:24942"}
[junit4:junit4] 2> 20204 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 20204 T2035 C91 P51885 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20205 T2035 C91 P51885 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20209 T2035 C91 P51885 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@720116b6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@720116b6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20210 T2035 C91 P51885 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20211 T2035 C91 P51885 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20212 T2035 C91 P51885 oass.SolrIndexSearcher.<init> Opening Searcher@c8e23b5 main
[junit4:junit4] 2> 20214 T2034 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c8e23b5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 20214 T2035 C91 P51885 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20215 T2035 C91 P51885 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20215 T2035 C91 P51885 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20215 T2035 C91 P51885 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20221 T1974 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:53260/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@14597f60
[junit4:junit4] 2> 20223 T1974 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 20223 T2067 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:53260. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 20224 T2067 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:53260, initiating session
[junit4:junit4] 2> 20224 T1976 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52638
[junit4:junit4] 2> 20224 T1976 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52638
[junit4:junit4] 2> 20253 T2035 C91 P51885 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20253 T2067 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:53260, sessionid = 0x13d85c0d871000c, negotiated timeout = 20000
[junit4:junit4] 2> 20253 T1978 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d85c0d871000c with negotiated timeout 20000 for client /140.211.11.196:52638
[junit4:junit4] 2> 20255 T2068 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14597f60 name:ZooKeeperConnection Watcher:127.0.0.1:53260/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 20255 T1974 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 20257 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d871000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20315 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d871000c type:create cxid:0x3 zxid:0x96 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20333 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51885_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51885"}
[junit4:junit4] 2> 20355 T1974 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 20395 T2049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20395 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20395 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20395 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20395 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20395 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21354 T2007 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=4&state=recovering&nodeName=127.0.0.1:24942_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 21396 T1974 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:29568_
[junit4:junit4] 2> 21397 T1979 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d85c0d871000c type:delete cxid:0xf zxid:0x9c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:29568_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:29568_
[junit4:junit4] 2> 21451 T1974 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:29568_
[junit4:junit4] 2> 21456 T2049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21456 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21456 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21456 T2016 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 21456 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21456 T2003 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 21457 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21457 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21458 T1996 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 21458 T2049 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 21591 T2032 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 21592 T2068 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 21599 T2069 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363748660229/collection1
[junit4:junit4] 2> 21600 T2069 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 21601 T2069 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 21601 T2069 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 21623 T2069 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363748660229/collection1/'
[junit4:junit4] 2> 21631 T2069 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363748660229/collection1/lib/README' to classloader
[junit4:junit4] 2> 21632 T2069 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1363748660229/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 21687 T2069 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 21736 T2069 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 21837 T2069 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 21842 T2069 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 22670 T2069 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 22682 T2069 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 22698 T2069 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 22714 T2069 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 22720 T2069 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 22725 T2069 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 22726 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 22726 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 22727 T2069 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 22728 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 22728 T2069 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 22728 T2069 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 22729 T2069 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363748660229/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/
[junit4:junit4] 2> 22729 T2069 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e392ce0
[junit4:junit4] 2> 22730 T2069 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 22735 T2069 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4 forceNew: false
[junit4:junit4] 2> 22736 T2069 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/index/
[junit4:junit4] 2> 22736 T2069 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 22737 T2069 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/index forceNew: false
[junit4:junit4] 2> 22764 T2069 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4820657e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 22765 T2069 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 22768 T2069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 22769 T2069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 22769 T2069 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 22770 T2069 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 22771 T2069 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 22771 T2069 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 22772 T2069 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 22773 T2069 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 22773 T2069 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 22787 T2069 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 22796 T2069 oass.SolrIndexSearcher.<init> Opening Searcher@5509f08c main
[junit4:junit4] 2> 22797 T2069 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 22797 T2069 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 22803 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5509f08c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 22805 T2069 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 22805 T2069 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> C92_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:24942_, base_url=http://127.0.0.1:24942}
[junit4:junit4] 2> 23356 T2052 C92 P24942 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51152/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 23356 T2052 C92 P24942 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:24942 START replicas=[http://127.0.0.1:51152/collection1/] nUpdates=100
[junit4:junit4] 2> 23357 T2052 C92 P24942 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 23357 T2052 C92 P24942 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 23358 T2052 C92 P24942 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 23358 T2052 C92 P24942 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 23358 T2052 C92 P24942 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 23358 T2052 C92 P24942 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51152/collection1/. core=collection1
[junit4:junit4] 2> 23359 T2052 C92 P24942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23361 T2008 C93 P51152 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 23381 T2011 C93 P51152 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23412 T2011 C93 P51152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 23413 T2011 C93 P51152 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 23414 T2011 C93 P51152 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23414 T2011 C93 P51152 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 33
[junit4:junit4] 2> 23416 T2052 C92 P24942 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 23416 T2052 C92 P24942 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 23418 T2010 C93 P51152 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 23419 T2052 C92 P24942 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 23420 T2052 C92 P24942 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 23420 T2052 C92 P24942 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 23423 T2010 C93 P51152 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4] 2> 23424 T2052 C92 P24942 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 23430 T2052 C92 P24942 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/index.20130319220424291 forceNew: false
[junit4:junit4] 2> 23431 T2052 C92 P24942 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/index.20130319220424291 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7f0d4297; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 23435 T2010 C93 P51152 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 23437 T2052 C92 P24942 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 23440 T2052 C92 P24942 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 23441 T2052 C92 P24942 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 23443 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23444 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:29568_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29568"}
[junit4:junit4] 2> 23445 T1997 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 23445 T1997 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 23445 T2052 C92 P24942 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@25aab21c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@25aab21c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 23446 T2052 C92 P24942 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 23447 T2052 C92 P24942 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 23448 T2052 C92 P24942 oass.SolrIndexSearcher.<init> Opening Searcher@1ded2648 main
[junit4:junit4] 2> 23449 T2051 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ded2648 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 23449 T2052 C92 P24942 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 23450 T2052 C92 P24942 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 23450 T2052 C92 P24942 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 23450 T2052 C92 P24942 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 23485 T2052 C92 P24942 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23488 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:24942_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:24942"}
[junit4:junit4] 2> 23530 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23530 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23530 T2049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23530 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23530 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23530 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23810 T2069 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 23810 T2069 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:29568 collection:collection1 shard:shard1
[junit4:junit4] 2> 23814 T2069 oasc.ZkController.register We are http://127.0.0.1:29568/collection1/ and leader is http://127.0.0.1:51152/collection1/
[junit4:junit4] 2> 23814 T2069 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:29568
[junit4:junit4] 2> 23815 T2069 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 23815 T2069 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C94 name=collection1 org.apache.solr.core.SolrCore@4e79ccbe url=http://127.0.0.1:29568/collection1 node=127.0.0.1:29568_ C94_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:29568_, base_url=http://127.0.0.1:29568}
[junit4:junit4] 2> 23815 T2073 C94 P29568 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 23816 T2073 C94 P29568 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 23816 T2069 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23816 T2073 C94 P29568 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 23816 T2073 C94 P29568 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 23817 T1974 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 23818 T1974 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 23818 T1974 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23888 T2073 C94 P29568 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 23887 T1974 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23889 T1974 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 23889 T1974 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 23890 T1974 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 24892 T1974 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25039 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25040 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:29568_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29568"}
[junit4:junit4] 2> 25082 T2049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25082 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25082 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25082 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25082 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25082 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 25895 T1974 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 25900 T2012 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=5&state=recovering&nodeName=127.0.0.1:29568_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 26898 T1974 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 27901 T1974 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C94_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:29568_, base_url=http://127.0.0.1:29568}
[junit4:junit4] 2> 27902 T2073 C94 P29568 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:51152/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 27902 T2073 C94 P29568 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:29568 START replicas=[http://127.0.0.1:51152/collection1/] nUpdates=100
[junit4:junit4] 2> 27903 T2073 C94 P29568 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 27903 T2073 C94 P29568 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 27903 T2073 C94 P29568 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 27904 T2073 C94 P29568 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 27904 T2073 C94 P29568 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 27904 T2073 C94 P29568 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:51152/collection1/. core=collection1
[junit4:junit4] 2> 27904 T2073 C94 P29568 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 27905 T2008 C93 P51152 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 27924 T2006 C93 P51152 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 27973 T2006 C93 P51152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 27974 T2006 C93 P51152 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 27974 T2006 C93 P51152 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 27975 T2006 C93 P51152 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 51
[junit4:junit4] 2> 27976 T2073 C94 P29568 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 27976 T2073 C94 P29568 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 27979 T2010 C93 P51152 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 27980 T2073 C94 P29568 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 27980 T2073 C94 P29568 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 27980 T2073 C94 P29568 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 27983 T2010 C93 P51152 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4] 2> 27983 T2073 C94 P29568 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 27985 T2073 C94 P29568 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/index.20130319220428851 forceNew: false
[junit4:junit4] 2> 27987 T2073 C94 P29568 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/index.20130319220428851 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2e96279e; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 27991 T2010 C93 P51152 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 27993 T2073 C94 P29568 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 27996 T2073 C94 P29568 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 27997 T2073 C94 P29568 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 28000 T2073 C94 P29568 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4820657e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4820657e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 28000 T2073 C94 P29568 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 28001 T2073 C94 P29568 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 28001 T2073 C94 P29568 oass.SolrIndexSearcher.<init> Opening Searcher@24a1ed8d main
[junit4:junit4] 2> 28003 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@24a1ed8d main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 28003 T2073 C94 P29568 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 28003 T2073 C94 P29568 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 28003 T2073 C94 P29568 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 28004 T2073 C94 P29568 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 28034 T2073 C94 P29568 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 28090 T1997 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 28091 T1997 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:29568_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:29568"}
[junit4:junit4] 2> 28197 T2003 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 28197 T2049 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 28197 T1996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 28197 T2032 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 28197 T2068 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 28197 T2016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 28903 T1974 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 28905 T1974 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C95 name=collection1 org.apache.solr.core.SolrCore@e107fae url=http://127.0.0.1:60566/collection1 node=127.0.0.1:60566_ C95_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:60566_, base_url=http://127.0.0.1:60566, leader=true}
[junit4:junit4] 2> 28914 T1986 C95 P60566 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 28918 T1986 C95 P60566 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@657a2ad6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 28919 T1986 C95 P60566 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 29052 T1986 C95 P60566 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@657a2ad6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@657a2ad6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 29053 T1986 C95 P60566 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 29056 T1986 C95 P60566 oass.SolrIndexSearcher.<init> Opening Searcher@44b77371 main
[junit4:junit4] 2> 29057 T1986 C95 P60566 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 29057 T2000 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@44b77371 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 29058 T1986 C95 P60566 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 144
[junit4:junit4] 2> 29069 T2009 C93 P51152 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 29099 T2009 C93 P51152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 29099 T2009 C93 P51152 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 29100 T2009 C93 P51152 oass.SolrIndexSearcher.<init> Opening Searcher@37eb8eca main
[junit4:junit4] 2> 29101 T2009 C93 P51152 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 29101 T2018 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@37eb8eca main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 29102 T2009 C93 P51152 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:51885/collection1/, StdNode: http://127.0.0.1:24942/collection1/, StdNode: http://127.0.0.1:29568/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> C92_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:24942_, base_url=http://127.0.0.1:24942}
[junit4:junit4] 2> 29113 T2039 C92 P24942 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C94_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:29568_, base_url=http://127.0.0.1:29568}
[junit4:junit4] 2> 29113 T2057 C94 P29568 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C91_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51885_, base_url=http://127.0.0.1:51885}
[junit4:junit4] 2> 29119 T2022 C91 P51885 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 29284 T2039 C92 P24942 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@25aab21c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@25aab21c; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 29285 T2039 C92 P24942 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 29286 T2039 C92 P24942 oass.SolrIndexSearcher.<init> Opening Searcher@33226591 main
[junit4:junit4] 2> 29287 T2057 C94 P29568 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4820657e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4820657e; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 29287 T2039 C92 P24942 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 29287 T2057 C94 P29568 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 29288 T2051 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33226591 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 29288 T2039 C92 P24942 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 175
[junit4:junit4] 2> 29289 T2057 C94 P29568 oass.SolrIndexSearcher.<init> Opening Searcher@15afb050 main
[junit4:junit4] 2> 29289 T2057 C94 P29568 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 29290 T2070 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15afb050 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 29290 T2057 C94 P29568 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 177
[junit4:junit4] 2> 29318 T2022 C91 P51885 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@720116b6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@720116b6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 29319 T2022 C91 P51885 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 29321 T2022 C91 P51885 oass.SolrIndexSearcher.<init> Opening Searcher@5f51683 main
[junit4:junit4] 2> 29321 T2022 C91 P51885 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 29322 T2034 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5f51683 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 29323 T2022 C91 P51885 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 204
[junit4:junit4] 2> 29324 T2009 C93 P51152 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 256
[junit4:junit4] 2> 29325 T1974 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 29328 T2007 C93 P51152 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 29329 T2023 C91 P51885 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 29332 T2040 C92 P24942 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 29333 T2058 C94 P29568 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 31350 T1986 C95 P60566 oass.SolrIndexSearcher.<init> Opening Searcher@758f4e8c realtime
[junit4:junit4] 2> 31351 T1986 C95 P60566 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429994127715467264)} 0 4
[junit4:junit4] 2> 31367 T2022 C91 P51885 /update {update.distrib=FROMLEADER&_version_=-1429994127723855872&update.from=http://127.0.0.1:51152/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429994127723855872)} 0 3
[junit4:junit4] 2> 31372 T2057 C94 P29568 /update {update.distrib=FROMLEADER&_version_=-1429994127723855872&update.from=http://127.0.0.1:51152/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429994127723855872)} 0 9
[junit4:junit4] 2> 31509 T2039 C92 P24942 /update {update.distrib=FROMLEADER&_version_=-1429994127723855872&update.from=http://127.0.0.1:51152/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1429994127723855872)} 0 146
[junit4:junit4] 2> 31511 T2009 C93 P51152 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1429994127723855872)} 0 156
[junit4:junit4] 2> 31520 T1986 C95 P60566 /update {wt=javabin&version=2} {add=[0 (1429994127892676608)]} 0 4
[junit4:junit4] 2> 31532 T2057 C94 P29568 /update {distrib.from=http://127.0.0.1:51152/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429994127902113792)]} 0 3
[junit4:junit4] 2> 31532 T2039 C92 P24942 /update {distrib.from=http://127.0.0.1:51152/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429994127902113792)]} 0 3
[junit4:junit4] 2> 31532 T2022 C91 P51885 /update {distrib.from=http://127.0.0.1:51152/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1429994127902113792)]} 0 3
[junit4:junit4] 2> 31533 T2009 C93 P51152 /update {wt=javabin&version=2} {add=[0 (1429994127902113792)]} 0 9
[junit4:junit4] 2> 31538 T1986 C95 P60566 /update {wt=javabin&version=2} {add=[1 (1429994127915745280)]} 0 1
[junit4:junit4] 2> 31545 T2057 C94 P29568 /update {distrib.from=http://127.0.0.1:51152/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429994127918891008)]} 0 1
[junit4:junit4] 2> 31545 T2022 C91 P51885 /update {distrib.from=http://127.0.0.1:51152/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429994127918891008)]} 0 1
[junit4:junit4] 2> 31545 T2039 C92 P24942 /update {distrib.from=http://127.0.0.1:51152/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429994127918891008)]} 0 1
[junit4:junit4] 2> 31546 T2009 C93 P51152 /update {wt=javabin&version=2} {add=[1 (1429994127918891008)]} 0 5
[junit4:junit4] 2> 31550 T1986 C95 P60566 /update {wt=javabin&version=2} {add=[2 (1429994127927279616)]} 0 1
[junit4:junit4] 2> 31557 T2039 C92 P24942 /update {distrib.from=http://127.0.0.1:51152/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429994127931473920)]} 0 1
[junit4:junit4] 2> 31557 T2057 C94 P29568 /update {distrib.from=http://127.0.0.1:51152/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1429994127931473920)]} 0 1
[junit4:junit4] 2> 31558 T2009 C93 P51152 /update {test.distrib.skip.servers=http://127.0.0.1:51885/collection1/&wt=javabin&version=2} {add=[2 (1429994127931473920)]} 0 5
[junit4:junit4] 2> 31562 T1986 C95 P60566 /update {wt=javabin&version=2} {add=[3 (1429994127939862528)]} 0 1
[junit4:junit4] 2> 31569 T2057 C94 P29568 /update {distrib.from=http://127.0.0.1:51152/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1429994127944056832)]} 0 1
[junit4:junit4] 2> 31570 T2009 C93 P51152 /update {test.distrib.skip.servers=http://127.0.0.1:51885/collection1/&test.distrib.skip.servers=http://127.0.0.1:24942/collection1/&wt=javabin&version=2} {add=[3 (1429994127944056832)]} 0 5
[junit4:junit4] 2> 31573 T1986 C95 P60566 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 32451 T1986 C95 P60566 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@657a2ad6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@657a2ad6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_0_Lucene41WithOrds_0.tib, _0_Lucene41_0.pos, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.nvd, _0.si, _0_Lucene41_0.tim, _0_Lucene41_0.tip, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_Lucene41_0.doc, _0_MockFixedIntBlock_0.doc, _0.fdx, _0.fdt, segments_3]
[junit4:junit4] 2> 32452 T1986 C95 P60566 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_Lucene41WithOrds_0.tib, _0_Lucene41_0.pos, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.nvd, _0.si, _0_Lucene41_0.tim, _0_Lucene41_0.tip, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_Lucene41_0.doc, _0_MockFixedIntBlock_0.doc, _0.fdx, _0.fdt, segments_3]
[junit4:junit4] 2> 32466 T1986 C95 P60566 oass.SolrIndexSearcher.<init> Opening Searcher@240f2262 main
[junit4:junit4] 2> 32466 T1986 C95 P60566 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 32467 T2000 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@240f2262 main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 32468 T1986 C95 P60566 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 895
[junit4:junit4] 2> 32471 T2009 C93 P51152 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 32825 T2009 C93 P51152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=5
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@2048694d; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6,filenames=[_0_Lucene41WithOrds_0.tib, _0_Lucene41_0.pos, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.nvd, _0.si, _0_Lucene41_0.tim, _0_Lucene41_0.tip, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_Lucene41_0.doc, _0_MockFixedIntBlock_0.doc, _0.fdx, segments_6, _0.fdt]
[junit4:junit4] 2> 32826 T2009 C93 P51152 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0_Lucene41WithOrds_0.tib, _0_Lucene41_0.pos, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.nvd, _0.si, _0_Lucene41_0.tim, _0_Lucene41_0.tip, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_Lucene41_0.doc, _0_MockFixedIntBlock_0.doc, _0.fdx, segments_6, _0.fdt]
[junit4:junit4] 2> 32839 T2009 C93 P51152 oass.SolrIndexSearcher.<init> Opening Searcher@54d741d8 main
[junit4:junit4] 2> 32840 T2009 C93 P51152 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 32841 T2018 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54d741d8 main{StandardDirectoryReader(segments_6:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 32841 T2009 C93 P51152 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:51885/collection1/, StdNode: http://127.0.0.1:24942/collection1/, StdNode: http://127.0.0.1:29568/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 32844 T2039 C92 P24942 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 32844 T2022 C91 P51885 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 32844 T2057 C94 P29568 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 33428 T2022 C91 P51885 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@720116b6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-1363748640873/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@720116b6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[_0_Lucene41WithOrds_0.tib, _0_Lucene41_0.pos, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.nvd, _0.si, _0_Lucene41_0.tim, _0_Lucene41_0.tip, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_Lucene41_0.doc, _0_MockFixedIntBlock_0.doc, _0.fdx, _0.fdt, segments_4]
[junit4:junit4] 2> 33429 T2022 C91 P51885 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[_0_Lucene41WithOrds_0.tib, _0_Lucene41_0.pos, _0_Lucene41WithOrds_0.tii, _0_Lucene41WithOrds_0.pos, _0_MockFixedIntBlock_0.tib, _0_MockFixedIntBlock_0.skp, _0_MockFixedIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockFixedIntBlock_0.tii, _0_Pulsing41_0.tip, _0.nvd, _0.si, _0_Lucene41_0.tim, _0_Lucene41_0.tip, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_MockFixedIntBlock_0.pos, _0.nvm, _0_MockFixedIntBlock_0.frq, _0_Pulsing41_0.pos, _0_Pulsing41_0.doc, _0_Lucene41_0.doc, _0_MockFixedIntBlock_0.doc, _0.fdx, _0.fdt, segments_4]
[junit4:junit4] 2>
[...truncated too long message...]
xSearcher.<init> Opening Searcher@44a0810 main
[junit4:junit4] 2> 7221043 T4040 oasc.SolrCore.registerSearcher [lazy1] Registered new searcher Searcher@3d8bfb21 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 7221044 T4038 oasc.SolrCore.registerSearcher [core1] Registered new searcher Searcher@610481b5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 7221044 T4039 oasc.SolrCore.registerSearcher [lazy2] Registered new searcher Searcher@44a0810 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 7221044 T4040 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 7221044 T4038 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 7221044 T4040 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 7221044 T4039 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 7221044 T4038 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 7221045 T4039 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 7221049 T4040 oasc.CoreMaps.putTransientCore Opening transient core lazy1
[junit4:junit4] 2> 7221049 T4038 oasc.CoreContainer.registerCore registering core: core1
[junit4:junit4] 2> 7221049 T4040 oasc.CoreContainer.registerCore registering core: lazy1
[junit4:junit4] 2> 7221049 T4039 oasc.CoreContainer.registerCore registering core: lazy2
[junit4:junit4] 2> 7221076 T4020 oas.SolrTestCaseJ4.tearDown ###Ending testPersistFalse
[junit4:junit4] 2> 7221078 T4020 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 7223384 T4019 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4:junit4] 2> 1) Thread[id=4024, name=searcherExecutor-2399-thread-1, state=WAITING, group=TGRP-TestSolrDiscoveryProperties]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 2) Thread[id=4020, name=SUITE-TestSolrDiscoveryProperties-seed#[EB01698C28D66809]-worker, state=TIMED_WAITING, group=TGRP-TestSolrDiscoveryProperties]
[junit4:junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4:junit4] 2> at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:235)
[junit4:junit4] 2> at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:100)
[junit4:junit4] 2> at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
[junit4:junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] 2> at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=pt_BR, timezone=US/Aleutian
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=6,free=181305000,total=536870912
[junit4:junit4] 2> NOTE: All tests run in this JVM: [ResponseLogComponentTest, DocValuesMultiTest, TestSuggestSpellingConverter, TestSolr4Spatial, SliceStateTest, TestIndexSearcher, PolyFieldTest, TestJoin, TestIBSimilarityFactory, TestSurroundQueryParser, BadComponentTest, TestUpdate, SliceStateUpdateTest, TestFaceting, OverseerCollectionProcessorTest, MoreLikeThisHandlerTest, LoggingHandlerTest, TestPseudoReturnFields, BasicDistributedZkTest, DistanceFunctionTest, PeerSyncTest, CachingDirectoryFactoryTest, TestFieldResource, TestCodecSupport, LegacyHTMLStripCharFilterTest, SpatialFilterTest, TestRandomFaceting, PathHierarchyTokenizerFactoryTest, SuggesterFSTTest, TestJmxIntegration, DirectSolrConnectionTest, TestSolrIndexConfig, OutputWriterTest, TestXIncludeConfig, IndexBasedSpellCheckerTest, DocumentAnalysisRequestHandlerTest, StatsComponentTest, WordBreakSolrSpellCheckerTest, ScriptEngineTest, BasicZkTest, DistributedSpellCheckComponentTest, DateFieldTest, TestBinaryResponseWriter, UpdateRequestProcessorFactoryTest, EchoParamsTest, AliasIntegrationTest, PreAnalyzedFieldTest, TestDefaultSimilarityFactory, TestValueSourceCache, SimplePostToolTest, ZkSolrClientTest, JsonLoaderTest, TestUtils, RecoveryZkTest, TestElisionMultitermQuery, MultiTermTest, CircularListTest, TestShardHandlerFactory, TestCollationKeyRangeQueries, DisMaxRequestHandlerTest, TestHashPartitioner, TestRecovery, TestPHPSerializedResponseWriter, TestLuceneMatchVersion, RequestHandlersTest, DOMUtilTest, BasicDistributedZk2Test, TestReplicationHandler, UnloadDistributedZkTest, OpenCloseCoreStressTest, TestRandomDVFaceting, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, TestStressRecovery, TestFiltering, TestReload, TestStressReorder, TestRealTimeGet, TestStressVersions, TestZkChroot, SimpleFacetsTest, HardAutoCommitTest, QueryElevationComponentTest, DirectUpdateHandlerTest, TestLazyCores, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SpellCheckCollatorTest, TestSolrDiscoveryProperties]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrDiscoveryProperties -Dtests.seed=EB01698C28D66809 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pt_BR -Dtests.timezone=US/Aleutian -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 0.00s J1 | TestSolrDiscoveryProperties (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([EB01698C28D66809]:0)
[junit4:junit4] Completed on J1 in 7223.43s, 3 tests, 2 errors <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:877: There were test failures: 273 suites, 1146 tests, 1 suite-level error, 1 error, 1 failure, 27 ignored (8 assumptions)
Total time: 175 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-Tests-4.x-java7 - Build # 1085 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-java7/1085/
1 tests failed.
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:10964/collection1 Dead Guy:http://127.0.0.1:10958/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:10972/collection1], CloudJettyRunner [url=http://127.0.0.1:10972/collection1]]
Stack Trace:
java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:10964/collection1 Dead Guy:http://127.0.0.1:10958/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:10972/collection1], CloudJettyRunner [url=http://127.0.0.1:10972/collection1]]
at __randomizedtesting.SeedInfo.seed([F3334E0CFA380FF7:72D5C0148D676FCB]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9154 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 0 T743 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 3 T743 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1363789533454
[junit4:junit4] 2> 4 T743 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 5 T744 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 8 T744 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 8 T744 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 8 T744 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 9 T744 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 9 T744 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1363789533454/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 106 T743 oasc.ZkTestServer.run start zk server on port:10947
[junit4:junit4] 2> 106 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d52f58f
[junit4:junit4] 2> 107 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 108 T749 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 108 T749 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 108 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10948
[junit4:junit4] 2> 109 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10948
[junit4:junit4] 2> 109 T747 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 111 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d1140000 with negotiated timeout 10000 for client /140.211.11.196:10948
[junit4:junit4] 2> 111 T749 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d1140000, negotiated timeout = 10000
[junit4:junit4] 2> 112 T750 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d52f58f name:ZooKeeperConnection Watcher:127.0.0.1:10947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 112 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 112 T743 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 115 T748 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8830d1140000
[junit4:junit4] 2> 116 T750 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 116 T743 oaz.ZooKeeper.close Session: 0x13d8830d1140000 closed
[junit4:junit4] 2> 116 T745 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:10948 which had sessionid 0x13d8830d1140000
[junit4:junit4] 2> 117 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@14cf43b9
[junit4:junit4] 2> 117 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 118 T751 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 118 T751 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 118 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10949
[junit4:junit4] 2> 119 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10949
[junit4:junit4] 2> 125 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d1140001 with negotiated timeout 10000 for client /140.211.11.196:10949
[junit4:junit4] 2> 125 T751 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d1140001, negotiated timeout = 10000
[junit4:junit4] 2> 125 T752 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14cf43b9 name:ZooKeeperConnection Watcher:127.0.0.1:10947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 126 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 126 T743 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 130 T743 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 134 T743 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 136 T743 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 140 T743 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 140 T743 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 152 T743 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 153 T743 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 256 T743 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 257 T743 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 260 T743 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 261 T743 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 271 T743 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 271 T743 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 275 T743 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 275 T743 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 278 T743 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 279 T743 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 283 T743 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 284 T743 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 287 T743 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 288 T743 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 291 T748 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8830d1140001
[junit4:junit4] 2> 291 T752 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 291 T745 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:10949 which had sessionid 0x13d8830d1140001
[junit4:junit4] 2> 291 T743 oaz.ZooKeeper.close Session: 0x13d8830d1140001 closed
[junit4:junit4] 2> 491 T743 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 498 T743 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:10950
[junit4:junit4] 2> 498 T743 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 499 T743 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 499 T743 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363789533742
[junit4:junit4] 2> 500 T743 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363789533742/solr.xml
[junit4:junit4] 2> 500 T743 oasc.CoreContainer.<init> New CoreContainer 2004343128
[junit4:junit4] 2> 501 T743 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363789533742/'
[junit4:junit4] 2> 502 T743 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363789533742/'
[junit4:junit4] 2> 566 T743 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 567 T743 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 568 T743 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 568 T743 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 569 T743 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 569 T743 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 569 T743 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 570 T743 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 570 T743 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 571 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 595 T743 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 615 T743 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:10947/solr
[junit4:junit4] 2> 616 T743 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 617 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1fc25b02
[junit4:junit4] 2> 618 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 618 T762 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 619 T762 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 619 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10951
[junit4:junit4] 2> 619 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10951
[junit4:junit4] 2> 626 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d1140002 with negotiated timeout 20000 for client /140.211.11.196:10951
[junit4:junit4] 2> 626 T762 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d1140002, negotiated timeout = 20000
[junit4:junit4] 2> 627 T763 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fc25b02 name:ZooKeeperConnection Watcher:127.0.0.1:10947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 627 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 628 T748 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8830d1140002
[junit4:junit4] 2> 635 T763 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 635 T745 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:10951 which had sessionid 0x13d8830d1140002
[junit4:junit4] 2> 635 T743 oaz.ZooKeeper.close Session: 0x13d8830d1140002 closed
[junit4:junit4] 2> 636 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 650 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3b602327
[junit4:junit4] 2> 651 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 651 T764 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 652 T764 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 652 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10952
[junit4:junit4] 2> 652 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10952
[junit4:junit4] 2> 654 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d1140003 with negotiated timeout 20000 for client /140.211.11.196:10952
[junit4:junit4] 2> 654 T764 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d1140003, negotiated timeout = 20000
[junit4:junit4] 2> 654 T765 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b602327 name:ZooKeeperConnection Watcher:127.0.0.1:10947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 654 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 657 T743 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 665 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140003 type:create cxid:0x7 zxid:0x1b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 666 T743 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 671 T743 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 677 T743 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:10950_
[junit4:junit4] 2> 678 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140003 type:delete cxid:0x12 zxid:0x1e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:10950_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:10950_
[junit4:junit4] 2> 679 T743 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:10950_
[junit4:junit4] 2> 683 T743 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 694 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140003 type:delete cxid:0x20 zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 696 T743 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 705 T743 oasc.Overseer.start Overseer (id=89377310864834563-127.0.0.1:10950_-n_0000000000) starting
[junit4:junit4] 2> 706 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140003 type:create cxid:0x25 zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 707 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140003 type:create cxid:0x26 zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 714 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140003 type:create cxid:0x28 zxid:0x27 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 715 T743 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 718 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140003 type:create cxid:0x2e zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 727 T767 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 728 T743 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 731 T743 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 733 T743 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 736 T766 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 740 T768 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363789533742/collection1
[junit4:junit4] 2> 740 T768 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 741 T768 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 741 T768 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 742 T768 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363789533742/collection1/'
[junit4:junit4] 2> 744 T768 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1363789533742/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 744 T768 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1363789533742/collection1/lib/README' to classloader
[junit4:junit4] 2> 795 T768 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 870 T768 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 971 T768 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 978 T768 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1642 T768 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1653 T768 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1669 T768 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1686 T768 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1691 T768 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1695 T768 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1697 T768 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1697 T768 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1697 T768 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1698 T768 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1699 T768 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1699 T768 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1734 T768 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1363789533742/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data/
[junit4:junit4] 2> 1734 T768 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16fe1b92
[junit4:junit4] 2> 1735 T768 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 1736 T768 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data forceNew: false
[junit4:junit4] 2> 1737 T768 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data/index/
[junit4:junit4] 2> 1737 T768 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1738 T768 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data/index forceNew: false
[junit4:junit4] 2> 1746 T768 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11bbd441; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1747 T768 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1750 T768 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1750 T768 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1751 T768 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1751 T768 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1752 T768 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1752 T768 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1752 T768 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1753 T768 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1753 T768 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1766 T768 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1774 T768 oass.SolrIndexSearcher.<init> Opening Searcher@3cec558 main
[junit4:junit4] 2> 1775 T768 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1776 T768 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1779 T769 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3cec558 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1781 T768 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1781 T768 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 2241 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2241 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:10950_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10950"}
[junit4:junit4] 2> 2241 T766 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2242 T766 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2254 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2784 T768 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2784 T768 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:10950 collection:control_collection shard:shard1
[junit4:junit4] 2> 2785 T768 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2803 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140003 type:delete cxid:0x82 zxid:0x35 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2804 T768 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2805 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140003 type:create cxid:0x83 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2815 T768 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2816 T768 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2816 T768 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:10950/collection1/
[junit4:junit4] 2> 2816 T768 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2817 T768 oasc.SyncStrategy.syncToMe http://127.0.0.1:10950/collection1/ has no replicas
[junit4:junit4] 2> 2817 T768 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:10950/collection1/
[junit4:junit4] 2> 2817 T768 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2823 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140003 type:create cxid:0x8e zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3760 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3777 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3803 T768 oasc.ZkController.register We are http://127.0.0.1:10950/collection1/ and leader is http://127.0.0.1:10950/collection1/
[junit4:junit4] 2> 3803 T768 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:10950
[junit4:junit4] 2> 3803 T768 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3803 T768 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3804 T768 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3806 T768 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3807 T743 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3807 T743 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3808 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3819 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3820 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@43161c55
[junit4:junit4] 2> 3821 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3821 T771 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 3822 T771 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 3822 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10957
[junit4:junit4] 2> 3822 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10957
[junit4:junit4] 2> 3824 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d1140004 with negotiated timeout 10000 for client /140.211.11.196:10957
[junit4:junit4] 2> 3824 T771 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d1140004, negotiated timeout = 10000
[junit4:junit4] 2> 3824 T772 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43161c55 name:ZooKeeperConnection Watcher:127.0.0.1:10947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3824 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3826 T743 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3827 T743 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3957 T743 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3960 T743 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:10958
[junit4:junit4] 2> 3960 T743 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3960 T743 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3961 T743 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363789537278
[junit4:junit4] 2> 3961 T743 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363789537278/solr.xml
[junit4:junit4] 2> 3961 T743 oasc.CoreContainer.<init> New CoreContainer 774457874
[junit4:junit4] 2> 3962 T743 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363789537278/'
[junit4:junit4] 2> 3962 T743 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363789537278/'
[junit4:junit4] 2> 4005 T743 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4006 T743 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4006 T743 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4006 T743 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4006 T743 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4007 T743 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4007 T743 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4007 T743 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4008 T743 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4008 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4024 T743 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4038 T743 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:10947/solr
[junit4:junit4] 2> 4038 T743 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4039 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4ca97517
[junit4:junit4] 2> 4039 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4040 T782 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4041 T782 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 4041 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10959
[junit4:junit4] 2> 4041 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10959
[junit4:junit4] 2> 4043 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d1140005 with negotiated timeout 20000 for client /140.211.11.196:10959
[junit4:junit4] 2> 4043 T782 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d1140005, negotiated timeout = 20000
[junit4:junit4] 2> 4043 T783 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ca97517 name:ZooKeeperConnection Watcher:127.0.0.1:10947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4043 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4045 T748 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8830d1140005
[junit4:junit4] 2> 4050 T783 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4050 T745 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:10959 which had sessionid 0x13d8830d1140005
[junit4:junit4] 2> 4050 T743 oaz.ZooKeeper.close Session: 0x13d8830d1140005 closed
[junit4:junit4] 2> 4051 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4060 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@691e89a2
[junit4:junit4] 2> 4061 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4061 T784 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 4062 T784 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 4062 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10960
[junit4:junit4] 2> 4062 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10960
[junit4:junit4] 2> 4064 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d1140006 with negotiated timeout 20000 for client /140.211.11.196:10960
[junit4:junit4] 2> 4064 T784 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d1140006, negotiated timeout = 20000
[junit4:junit4] 2> 4064 T785 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@691e89a2 name:ZooKeeperConnection Watcher:127.0.0.1:10947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4064 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4066 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140006 type:create cxid:0x1 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4068 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140006 type:create cxid:0x3 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4076 T743 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5079 T743 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:10958_
[junit4:junit4] 2> 5081 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140006 type:delete cxid:0xd zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:10958_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:10958_
[junit4:junit4] 2> 5082 T743 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:10958_
[junit4:junit4] 2> 5086 T785 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5086 T772 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5086 T765 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5086 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5103 T786 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363789537278/collection1
[junit4:junit4] 2> 5104 T786 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5104 T786 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5104 T786 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5106 T786 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363789537278/collection1/'
[junit4:junit4] 2> 5107 T786 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1363789537278/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5108 T786 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1363789537278/collection1/lib/README' to classloader
[junit4:junit4] 2> 5158 T786 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 5218 T786 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5285 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5285 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:10950__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:10950_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10950"}
[junit4:junit4] 2> 5298 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5298 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5319 T786 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5319 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5326 T786 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5993 T786 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6003 T786 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6007 T786 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6023 T786 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6028 T786 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6033 T786 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6035 T786 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6035 T786 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6035 T786 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6037 T786 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6037 T786 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6037 T786 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 6037 T786 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1363789537278/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/
[junit4:junit4] 2> 6038 T786 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16fe1b92
[junit4:junit4] 2> 6038 T786 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 6039 T786 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1 forceNew: false
[junit4:junit4] 2> 6040 T786 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index/
[junit4:junit4] 2> 6040 T786 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6041 T786 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index forceNew: false
[junit4:junit4] 2> 6047 T786 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6047 T786 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6050 T786 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6051 T786 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6051 T786 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6052 T786 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6053 T786 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6053 T786 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6053 T786 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6054 T786 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6054 T786 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6066 T786 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6074 T786 oass.SolrIndexSearcher.<init> Opening Searcher@c481f1a main
[junit4:junit4] 2> 6075 T786 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6075 T786 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6080 T787 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c481f1a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6082 T786 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6082 T786 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6803 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6803 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10958_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10958"}
[junit4:junit4] 2> 6804 T766 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 6804 T766 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6842 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6843 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6843 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7085 T786 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7085 T786 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:10958 collection:collection1 shard:shard1
[junit4:junit4] 2> 7086 T786 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7142 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140006 type:delete cxid:0x4a zxid:0x5a txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7143 T786 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7143 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140006 type:create cxid:0x4b zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7157 T786 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7157 T786 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7157 T786 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:10958/collection1/
[junit4:junit4] 2> 7158 T786 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7158 T786 oasc.SyncStrategy.syncToMe http://127.0.0.1:10958/collection1/ has no replicas
[junit4:junit4] 2> 7158 T786 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:10958/collection1/
[junit4:junit4] 2> 7158 T786 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7163 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140006 type:create cxid:0x56 zxid:0x5f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8347 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8364 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8364 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8364 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8398 T786 oasc.ZkController.register We are http://127.0.0.1:10958/collection1/ and leader is http://127.0.0.1:10958/collection1/
[junit4:junit4] 2> 8398 T786 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:10958
[junit4:junit4] 2> 8398 T786 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8398 T786 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8398 T786 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8400 T786 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8401 T743 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8402 T743 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8402 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8546 T743 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8549 T743 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:10964
[junit4:junit4] 2> 8549 T743 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8550 T743 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8550 T743 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363789541864
[junit4:junit4] 2> 8550 T743 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363789541864/solr.xml
[junit4:junit4] 2> 8551 T743 oasc.CoreContainer.<init> New CoreContainer 1783117957
[junit4:junit4] 2> 8551 T743 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363789541864/'
[junit4:junit4] 2> 8552 T743 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363789541864/'
[junit4:junit4] 2> 8594 T743 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8595 T743 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8595 T743 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8596 T743 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8596 T743 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8596 T743 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8597 T743 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8597 T743 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8597 T743 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8598 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8613 T743 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8627 T743 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:10947/solr
[junit4:junit4] 2> 8628 T743 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8629 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@ad719c9
[junit4:junit4] 2> 8630 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8630 T798 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8631 T798 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 8631 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10965
[junit4:junit4] 2> 8631 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10965
[junit4:junit4] 2> 8632 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d1140007 with negotiated timeout 20000 for client /140.211.11.196:10965
[junit4:junit4] 2> 8633 T798 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d1140007, negotiated timeout = 20000
[junit4:junit4] 2> 8633 T799 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ad719c9 name:ZooKeeperConnection Watcher:127.0.0.1:10947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8633 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8634 T748 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8830d1140007
[junit4:junit4] 2> 8635 T799 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8635 T745 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:10965 which had sessionid 0x13d8830d1140007
[junit4:junit4] 2> 8635 T743 oaz.ZooKeeper.close Session: 0x13d8830d1140007 closed
[junit4:junit4] 2> 8636 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8645 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@58741a85
[junit4:junit4] 2> 8646 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8646 T800 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 8646 T800 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 8647 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10966
[junit4:junit4] 2> 8647 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10966
[junit4:junit4] 2> 8648 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d1140008 with negotiated timeout 20000 for client /140.211.11.196:10966
[junit4:junit4] 2> 8648 T800 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d1140008, negotiated timeout = 20000
[junit4:junit4] 2> 8648 T801 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58741a85 name:ZooKeeperConnection Watcher:127.0.0.1:10947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8648 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8649 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140008 type:create cxid:0x1 zxid:0x6c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8651 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140008 type:create cxid:0x3 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8661 T743 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9664 T743 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:10964_
[junit4:junit4] 2> 9666 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d1140008 type:delete cxid:0xd zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:10964_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:10964_
[junit4:junit4] 2> 9667 T743 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:10964_
[junit4:junit4] 2> 9702 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9702 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9703 T765 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9703 T801 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9704 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9705 T785 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9705 T772 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9712 T802 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363789541864/collection1
[junit4:junit4] 2> 9712 T802 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9713 T802 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9713 T802 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9714 T802 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363789541864/collection1/'
[junit4:junit4] 2> 9715 T802 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1363789541864/collection1/lib/README' to classloader
[junit4:junit4] 2> 9716 T802 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1363789541864/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9768 T802 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 9843 T802 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9880 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9881 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:10958__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10958_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10958"}
[junit4:junit4] 2> 9902 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9902 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9902 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9944 T802 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9944 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9951 T802 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10631 T802 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10643 T802 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10647 T802 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10664 T802 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10673 T802 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10680 T802 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10682 T802 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10683 T802 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10683 T802 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10685 T802 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10685 T802 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10686 T802 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 10686 T802 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1363789541864/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/
[junit4:junit4] 2> 10686 T802 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16fe1b92
[junit4:junit4] 2> 10687 T802 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 10689 T802 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2 forceNew: false
[junit4:junit4] 2> 10690 T802 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index/
[junit4:junit4] 2> 10691 T802 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10692 T802 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index forceNew: false
[junit4:junit4] 2> 10705 T802 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f54aef4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10705 T802 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10710 T802 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10711 T802 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10712 T802 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10713 T802 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10714 T802 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10715 T802 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10715 T802 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10716 T802 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10717 T802 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10740 T802 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10754 T802 oass.SolrIndexSearcher.<init> Opening Searcher@76955a07 main
[junit4:junit4] 2> 10756 T802 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10756 T802 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10763 T803 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@76955a07 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10767 T802 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10767 T802 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11408 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11409 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10964_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10964"}
[junit4:junit4] 2> 11409 T766 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 11410 T766 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11422 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11422 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11422 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11422 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11770 T802 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11770 T802 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:10964 collection:collection1 shard:shard1
[junit4:junit4] 2> 11773 T802 oasc.ZkController.register We are http://127.0.0.1:10964/collection1/ and leader is http://127.0.0.1:10958/collection1/
[junit4:junit4] 2> 11773 T802 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:10964
[junit4:junit4] 2> 11774 T802 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 11774 T802 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C63 name=collection1 org.apache.solr.core.SolrCore@5bfaff85 url=http://127.0.0.1:10964/collection1 node=127.0.0.1:10964_ C63_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:10964_, base_url=http://127.0.0.1:10964}
[junit4:junit4] 2> 11774 T804 C63 P10964 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 11775 T802 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11775 T804 C63 P10964 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 11776 T804 C63 P10964 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 11776 T804 C63 P10964 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11776 T743 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 11777 T743 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 11778 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11778 T804 C63 P10964 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 12000 T743 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 12003 T743 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:10972
[junit4:junit4] 2> 12004 T743 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 12004 T743 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 12005 T743 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363789545252
[junit4:junit4] 2> 12005 T743 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363789545252/solr.xml
[junit4:junit4] 2> 12006 T743 oasc.CoreContainer.<init> New CoreContainer 1946731567
[junit4:junit4] 2> 12006 T743 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363789545252/'
[junit4:junit4] 2> 12007 T743 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363789545252/'
[junit4:junit4] 2> 12071 T743 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 12072 T743 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 12072 T743 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 12073 T743 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 12073 T743 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 12074 T743 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 12074 T743 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 12075 T743 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 12075 T743 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 12076 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 12099 T743 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 12119 T743 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:10947/solr
[junit4:junit4] 2> 12120 T743 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 12120 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@300fbffa
[junit4:junit4] 2> 12121 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12122 T815 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12123 T815 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 12123 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10973
[junit4:junit4] 2> 12123 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10973
[junit4:junit4] 2> 12125 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d1140009 with negotiated timeout 20000 for client /140.211.11.196:10973
[junit4:junit4] 2> 12125 T815 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d1140009, negotiated timeout = 20000
[junit4:junit4] 2> 12126 T816 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@300fbffa name:ZooKeeperConnection Watcher:127.0.0.1:10947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12126 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12127 T748 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8830d1140009
[junit4:junit4] 2> 12129 T816 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 12129 T745 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:10973 which had sessionid 0x13d8830d1140009
[junit4:junit4] 2> 12129 T743 oaz.ZooKeeper.close Session: 0x13d8830d1140009 closed
[junit4:junit4] 2> 12129 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 12143 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@30481ae8
[junit4:junit4] 2> 12144 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 12144 T817 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 12145 T817 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 12145 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10974
[junit4:junit4] 2> 12145 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10974
[junit4:junit4] 2> 12147 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d114000a with negotiated timeout 20000 for client /140.211.11.196:10974
[junit4:junit4] 2> 12147 T817 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d114000a, negotiated timeout = 20000
[junit4:junit4] 2> 12147 T818 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30481ae8 name:ZooKeeperConnection Watcher:127.0.0.1:10947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 12147 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 12148 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d114000a type:create cxid:0x1 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12150 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d114000a type:create cxid:0x3 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12153 T743 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 12927 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12928 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:10964__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10964_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10964"}
[junit4:junit4] 2> 12941 T818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12941 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12941 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12941 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12941 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13156 T743 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:10972_
[junit4:junit4] 2> 13158 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d114000a type:delete cxid:0xf zxid:0x85 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:10972_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:10972_
[junit4:junit4] 2> 13159 T743 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:10972_
[junit4:junit4] 2> 13161 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13162 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13162 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13162 T818 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13162 T765 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13162 T818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13162 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 13164 T801 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13164 T785 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13164 T772 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 13176 T819 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363789545252/collection1
[junit4:junit4] 2> 13176 T819 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 13177 T819 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 13177 T819 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 13178 T819 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363789545252/collection1/'
[junit4:junit4] 2> 13180 T819 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1363789545252/collection1/lib/README' to classloader
[junit4:junit4] 2> 13180 T819 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1363789545252/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13233 T819 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 13293 T819 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13394 T819 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 13401 T819 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13807 T775 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:10964__collection1&state=recovering&nodeName=127.0.0.1:10964_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 14101 T819 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14113 T819 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14118 T819 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14134 T819 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14140 T819 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14145 T819 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14146 T819 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14147 T819 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14147 T819 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14148 T819 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14149 T819 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 14149 T819 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 14149 T819 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1363789545252/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/
[junit4:junit4] 2> 14150 T819 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16fe1b92
[junit4:junit4] 2> 14150 T819 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 14151 T819 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3 forceNew: false
[junit4:junit4] 2> 14152 T819 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index/
[junit4:junit4] 2> 14153 T819 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 14154 T819 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index forceNew: false
[junit4:junit4] 2> 14160 T819 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@31674127; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 14161 T819 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 14164 T819 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 14164 T819 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 14165 T819 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 14166 T819 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 14166 T819 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 14167 T819 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 14167 T819 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 14168 T819 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 14168 T819 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 14183 T819 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 14192 T819 oass.SolrIndexSearcher.<init> Opening Searcher@511af6db main
[junit4:junit4] 2> 14193 T819 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 14194 T819 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 14199 T820 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@511af6db main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 14201 T819 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 14201 T819 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14448 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14449 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10972_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10972"}
[junit4:junit4] 2> 14449 T766 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 14449 T766 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 14477 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14477 T818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14477 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14477 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14477 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15204 T819 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 15204 T819 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:10972 collection:collection1 shard:shard1
[junit4:junit4] 2> 15208 T819 oasc.ZkController.register We are http://127.0.0.1:10972/collection1/ and leader is http://127.0.0.1:10958/collection1/
[junit4:junit4] 2> 15209 T819 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:10972
[junit4:junit4] 2> 15209 T819 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 15209 T819 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C64 name=collection1 org.apache.solr.core.SolrCore@21b7b8f7 url=http://127.0.0.1:10972/collection1 node=127.0.0.1:10972_ C64_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:10972_, base_url=http://127.0.0.1:10972}
[junit4:junit4] 2> 15209 T821 C64 P10972 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 15210 T821 C64 P10972 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 15210 T819 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15211 T821 C64 P10972 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 15211 T821 C64 P10972 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15212 T743 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 15212 T821 C64 P10972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15212 T743 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 15213 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 15426 T743 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 15429 T743 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:10986
[junit4:junit4] 2> 15430 T743 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 15430 T743 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 15431 T743 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363789548684
[junit4:junit4] 2> 15431 T743 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363789548684/solr.xml
[junit4:junit4] 2> 15432 T743 oasc.CoreContainer.<init> New CoreContainer 856607126
[junit4:junit4] 2> 15432 T743 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363789548684/'
[junit4:junit4] 2> 15433 T743 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363789548684/'
[junit4:junit4] 2> 15497 T743 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 15498 T743 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 15498 T743 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 15499 T743 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 15499 T743 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 15499 T743 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 15500 T743 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 15500 T743 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 15501 T743 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 15501 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 15523 T743 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 15543 T743 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:10947/solr
[junit4:junit4] 2> 15544 T743 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 15544 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@564feb91
[junit4:junit4] 2> 15545 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 15546 T832 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 15546 T832 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 15547 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10987
[junit4:junit4] 2> 15547 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10987
[junit4:junit4] 2> 15549 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d114000b with negotiated timeout 20000 for client /140.211.11.196:10987
[junit4:junit4] 2> 15549 T832 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d114000b, negotiated timeout = 20000
[junit4:junit4] 2> 15549 T833 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@564feb91 name:ZooKeeperConnection Watcher:127.0.0.1:10947 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 15549 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 15551 T748 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d8830d114000b
[junit4:junit4] 2> 15552 T833 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 15552 T745 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:10987 which had sessionid 0x13d8830d114000b
[junit4:junit4] 2> 15552 T743 oaz.ZooKeeper.close Session: 0x13d8830d114000b closed
[junit4:junit4] 2> 15552 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 15564 T743 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:10947/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@cd02eb7
[junit4:junit4] 2> 15565 T743 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 15565 T834 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:10947. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 15566 T834 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:10947, initiating session
[junit4:junit4] 2> 15566 T745 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10988
[junit4:junit4] 2> 15566 T745 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10988
[junit4:junit4] 2> 15567 T747 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d8830d114000c with negotiated timeout 20000 for client /140.211.11.196:10988
[junit4:junit4] 2> 15567 T834 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:10947, sessionid = 0x13d8830d114000c, negotiated timeout = 20000
[junit4:junit4] 2> 15568 T835 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cd02eb7 name:ZooKeeperConnection Watcher:127.0.0.1:10947/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 15568 T743 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 15569 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d114000c type:create cxid:0x1 zxid:0x92 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 15574 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d114000c type:create cxid:0x3 zxid:0x93 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 15576 T743 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> C63_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:10964_, base_url=http://127.0.0.1:10964}
[junit4:junit4] 2> 15809 T804 C63 P10964 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:10958/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 15809 T804 C63 P10964 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:10964 START replicas=[http://127.0.0.1:10958/collection1/] nUpdates=100
[junit4:junit4] 2> 15810 T804 C63 P10964 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 15810 T804 C63 P10964 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 15811 T804 C63 P10964 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 15811 T804 C63 P10964 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 15811 T804 C63 P10964 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 15811 T804 C63 P10964 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:10958/collection1/. core=collection1
[junit4:junit4] 2> 15811 T804 C63 P10964 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C65 name=collection1 org.apache.solr.core.SolrCore@11be6ed0 url=http://127.0.0.1:10958/collection1 node=127.0.0.1:10958_ C65_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:10958_, base_url=http://127.0.0.1:10958, leader=true}
[junit4:junit4] 2> 15819 T777 C65 P10958 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 15825 T778 C65 P10958 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 15830 T778 C65 P10958 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15831 T778 C65 P10958 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15838 T778 C65 P10958 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15838 T778 C65 P10958 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15840 T778 C65 P10958 oass.SolrIndexSearcher.<init> Opening Searcher@244ec142 realtime
[junit4:junit4] 2> 15841 T778 C65 P10958 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15841 T778 C65 P10958 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4] 2> 15842 T804 C63 P10964 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15842 T804 C63 P10964 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 15845 T779 C65 P10958 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15846 T779 C65 P10958 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 15847 T804 C63 P10964 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 15847 T804 C63 P10964 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 15847 T804 C63 P10964 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 15850 T779 C65 P10958 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 15851 T804 C63 P10964 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 15852 T804 C63 P10964 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index.20130320182549302 forceNew: false
[junit4:junit4] 2> 15854 T804 C63 P10964 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index.20130320182549302 lockFactory=org.apache.lucene.store.NativeFSLockFactory@18723646; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 15857 T779 C65 P10958 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 15859 T804 C63 P10964 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 15863 T804 C63 P10964 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 15863 T804 C63 P10964 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 15868 T804 C63 P10964 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f54aef4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f54aef4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15869 T804 C63 P10964 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15869 T804 C63 P10964 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 15870 T804 C63 P10964 oass.SolrIndexSearcher.<init> Opening Searcher@1737c526 main
[junit4:junit4] 2> 15871 T803 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1737c526 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 15872 T804 C63 P10964 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 15872 T804 C63 P10964 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 15872 T804 C63 P10964 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 15872 T804 C63 P10964 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15874 T804 C63 P10964 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 15983 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15985 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:10972__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10972_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10972"}
[junit4:junit4] 2> 15990 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:10964__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10964_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10964"}
[junit4:junit4] 2> 16012 T818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16013 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16012 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16013 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16013 T835 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16013 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16237 T776 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:10972__collection1&state=recovering&nodeName=127.0.0.1:10972_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 16580 T743 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:10986_
[junit4:junit4] 2> 16581 T748 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d8830d114000c type:delete cxid:0xf zxid:0x9c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:10986_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:10986_
[junit4:junit4] 2> 16585 T743 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:10986_
[junit4:junit4] 2> 16588 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16588 T835 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16588 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16588 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16602 T765 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16589 T818 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16602 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16603 T818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16604 T772 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16604 T785 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16604 T835 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16605 T801 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 16611 T838 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363789548684/collection1
[junit4:junit4] 2> 16611 T838 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 16612 T838 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 16612 T838 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 16613 T838 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363789548684/collection1/'
[junit4:junit4] 2> 16615 T838 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1363789548684/collection1/lib/README' to classloader
[junit4:junit4] 2> 16615 T838 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1363789548684/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 16692 T838 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_43
[junit4:junit4] 2> 16752 T838 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 16853 T838 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 16860 T838 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17537 T838 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17549 T838 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17553 T838 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17569 T838 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17574 T838 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17579 T838 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17580 T838 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17581 T838 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17581 T838 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17582 T838 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17582 T838 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17583 T838 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 17583 T838 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1363789548684/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/
[junit4:junit4] 2> 17583 T838 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16fe1b92
[junit4:junit4] 2> 17584 T838 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 17585 T838 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4 forceNew: false
[junit4:junit4] 2> 17585 T838 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index/
[junit4:junit4] 2> 17586 T838 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17587 T838 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index forceNew: false
[junit4:junit4] 2> 17594 T838 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@556aa027; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17595 T838 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17598 T838 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17598 T838 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17599 T838 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17600 T838 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17600 T838 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17600 T838 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17601 T838 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17601 T838 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17602 T838 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17616 T838 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17624 T838 oass.SolrIndexSearcher.<init> Opening Searcher@27323315 main
[junit4:junit4] 2> 17626 T838 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17626 T838 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17630 T839 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27323315 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17633 T838 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 17633 T838 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> C64_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:10972_, base_url=http://127.0.0.1:10972}
[junit4:junit4] 2> 18239 T821 C64 P10972 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:10958/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 18239 T821 C64 P10972 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:10972 START replicas=[http://127.0.0.1:10958/collection1/] nUpdates=100
[junit4:junit4] 2> 18239 T821 C64 P10972 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 18240 T821 C64 P10972 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 18240 T821 C64 P10972 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 18240 T821 C64 P10972 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 18240 T821 C64 P10972 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 18240 T821 C64 P10972 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:10958/collection1/. core=collection1
[junit4:junit4] 2> 18241 T821 C64 P10972 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18242 T777 C65 P10958 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 18253 T780 C65 P10958 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 18257 T780 C65 P10958 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18257 T780 C65 P10958 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18258 T780 C65 P10958 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18258 T780 C65 P10958 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 18259 T821 C64 P10972 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18260 T821 C64 P10972 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 18262 T779 C65 P10958 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 18263 T821 C64 P10972 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 18263 T821 C64 P10972 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 18263 T821 C64 P10972 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 18266 T779 C65 P10958 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1
[junit4:junit4] 2> 18266 T821 C64 P10972 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 18267 T821 C64 P10972 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index.20130320182551717 forceNew: false
[junit4:junit4] 2> 18268 T821 C64 P10972 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index.20130320182551717 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3a8c12cf; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 18272 T779 C65 P10958 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 18273 T821 C64 P10972 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 18275 T821 C64 P10972 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 18276 T821 C64 P10972 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 18278 T821 C64 P10972 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@31674127; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@31674127; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18279 T821 C64 P10972 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18279 T821 C64 P10972 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 18279 T821 C64 P10972 oass.SolrIndexSearcher.<init> Opening Searcher@1163adab main
[junit4:junit4] 2> 18281 T820 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1163adab main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 18281 T821 C64 P10972 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 18281 T821 C64 P10972 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 18281 T821 C64 P10972 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 18281 T821 C64 P10972 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18283 T821 C64 P10972 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 19024 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19025 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10986_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10986"}
[junit4:junit4] 2> 19025 T766 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 19025 T766 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 19030 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:10972__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10972_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10972"}
[junit4:junit4] 2> 19042 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19042 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19042 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19042 T818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19042 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19042 T835 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19637 T838 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 19637 T838 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:10986 collection:collection1 shard:shard1
[junit4:junit4] 2> 19664 T838 oasc.ZkController.register We are http://127.0.0.1:10986/collection1/ and leader is http://127.0.0.1:10958/collection1/
[junit4:junit4] 2> 19664 T838 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:10986
[junit4:junit4] 2> 19664 T838 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 19664 T838 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C66 name=collection1 org.apache.solr.core.SolrCore@2e4bc07a url=http://127.0.0.1:10986/collection1 node=127.0.0.1:10986_ C66_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:10986_, base_url=http://127.0.0.1:10986}
[junit4:junit4] 2> 19665 T842 C66 P10986 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 19665 T838 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19666 T842 C66 P10986 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 19667 T842 C66 P10986 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 19667 T842 C66 P10986 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19667 T743 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1
[junit4:junit4] 2> 19668 T743 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 19669 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19683 T842 C66 P10986 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 19688 T743 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19689 T743 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 19690 T743 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 19690 T743 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20557 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20558 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:10986__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10986_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10986"}
[junit4:junit4] 2> 20569 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20569 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20569 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20569 T835 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20569 T818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20569 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20692 T743 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20699 T781 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:10986__collection1&state=recovering&nodeName=127.0.0.1:10986_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 21694 T743 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22697 T743 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C66_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:10986_, base_url=http://127.0.0.1:10986}
[junit4:junit4] 2> 22701 T842 C66 P10986 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:10958/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 22701 T842 C66 P10986 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:10986 START replicas=[http://127.0.0.1:10958/collection1/] nUpdates=100
[junit4:junit4] 2> 22701 T842 C66 P10986 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 22702 T842 C66 P10986 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 22702 T842 C66 P10986 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 22702 T842 C66 P10986 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 22702 T842 C66 P10986 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 22702 T842 C66 P10986 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:10958/collection1/. core=collection1
[junit4:junit4] 2> 22703 T842 C66 P10986 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 22705 T777 C65 P10958 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 22718 T775 C65 P10958 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22722 T775 C65 P10958 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 22723 T775 C65 P10958 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 22724 T775 C65 P10958 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 22724 T775 C65 P10958 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 22726 T842 C66 P10986 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 22726 T842 C66 P10986 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 22728 T779 C65 P10958 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 22729 T842 C66 P10986 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 22729 T842 C66 P10986 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 22730 T842 C66 P10986 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 22733 T779 C65 P10958 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4:junit4] 2> 22734 T842 C66 P10986 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 22735 T842 C66 P10986 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index.20130320182556184 forceNew: false
[junit4:junit4] 2> 22736 T842 C66 P10986 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index.20130320182556184 lockFactory=org.apache.lucene.store.NativeFSLockFactory@684e384f; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 22739 T779 C65 P10958 REQ /replication {file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4:junit4] 2> 22741 T842 C66 P10986 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 22743 T842 C66 P10986 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 22743 T842 C66 P10986 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 22747 T842 C66 P10986 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@556aa027; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@556aa027; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 22748 T842 C66 P10986 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 22748 T842 C66 P10986 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 22749 T842 C66 P10986 oass.SolrIndexSearcher.<init> Opening Searcher@5caa2283 main
[junit4:junit4] 2> 22750 T839 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5caa2283 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 22751 T842 C66 P10986 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 22751 T842 C66 P10986 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 22751 T842 C66 P10986 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 22752 T842 C66 P10986 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 22753 T842 C66 P10986 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 23581 T766 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23582 T766 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:10986__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:10986_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:10986"}
[junit4:junit4] 2> 23588 T818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23588 T801 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23588 T772 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23588 T835 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23588 T765 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23588 T785 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 23700 T743 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23702 T743 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C67 name=collection1 org.apache.solr.core.SolrCore@b159ebd url=http://127.0.0.1:10950/collection1 node=127.0.0.1:10950_ C67_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:10950_, base_url=http://127.0.0.1:10950, leader=true}
[junit4:junit4] 2> 23713 T755 C67 P10950 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23718 T755 C67 P10950 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11bbd441; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 23718 T755 C67 P10950 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 23723 T755 C67 P10950 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11bbd441; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11bbd441; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 23723 T755 C67 P10950 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 23727 T755 C67 P10950 oass.SolrIndexSearcher.<init> Opening Searcher@374dc2b4 main
[junit4:junit4] 2> 23727 T755 C67 P10950 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23728 T769 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@374dc2b4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 23729 T755 C67 P10950 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4] 2> 23742 T778 C65 P10958 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23746 T778 C65 P10958 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=4
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 23747 T778 C65 P10958 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 23748 T778 C65 P10958 oass.SolrIndexSearcher.<init> Opening Searcher@38e15d63 main
[junit4:junit4] 2> 23749 T778 C65 P10958 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23750 T787 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@38e15d63 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 23750 T778 C65 P10958 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:10964/collection1/, StdNode: http://127.0.0.1:10972/collection1/, StdNode: http://127.0.0.1:10986/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> C64_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:10972_, base_url=http://127.0.0.1:10972}
[junit4:junit4] 2> 23767 T808 C64 P10972 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23773 T808 C64 P10972 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@31674127; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@31674127; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 23773 T808 C64 P10972 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 23776 T808 C64 P10972 oass.SolrIndexSearcher.<init> Opening Searcher@2dadfcbe main
[junit4:junit4] 2> 23776 T808 C64 P10972 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> C66_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:10986_, base_url=http://127.0.0.1:10986}
[junit4:junit4] 2> 23777 T825 C66 P10986 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C63_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:10964_, base_url=http://127.0.0.1:10964}
[junit4:junit4] 2> 23777 T791 C63 P10964 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 23777 T820 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2dadfcbe main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 23778 T808 C64 P10972 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 11
[junit4:junit4] 2> 23783 T791 C63 P10964 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f54aef4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f54aef4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 23783 T825 C66 P10986 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@556aa027; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@556aa027; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> 23784 T791 C63 P10964 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 23784 T825 C66 P10986 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[segments_5]
[junit4:junit4] 2> 23787 T791 C63 P10964 oass.SolrIndexSearcher.<init> Opening Searcher@2ba56d9 main
[junit4:junit4] 2> 23787 T825 C66 P10986 oass.SolrIndexSearcher.<init> Opening Searcher@179bc1f5 main
[junit4:junit4] 2> 23787 T791 C63 P10964 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23787 T825 C66 P10986 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 23788 T803 oasc.JmxMonitoredMap.put WARNING Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:513)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:239)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1763)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.access$000(SolrCore.java:129)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1640)
[junit4:junit4] 2> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 23788 T839 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@179bc1f5 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 23789 T825 C66 P10986 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 12
[junit4:junit4] 2> 23789 T803 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2ba56d9 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 23790 T791 C63 P10964 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 13
[junit4:junit4] 2> 23791 T778 C65 P10958 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 49
[junit4:junit4] 2> 23792 T743 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 23795 T776 C65 P10958 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 23799 T792 C63 P10964 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 23801 T809 C64 P10972 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 23804 T826 C66 P10986 REQ /select {tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 25810 T755 C67 P10950 oass.SolrIndexSearcher.<init> Opening Searcher@542ab85a realtime
[junit4:junit4] 2> 25810 T755 C67 P10950 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1430037000888516608)} 0 3
[junit4:junit4] 2> 25820 T825 C66 P10986 /update {update.distrib=FROMLEADER&_version_=-1430037000894808064&update.from=http://127.0.0.1:10958/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1430037000894808064)} 0 2
[junit4:junit4] 2> 25820 T791 C63 P10964 /update {update.distrib=FROMLEADER&_version_=-1430037000894808064&update.from=http://127.0.0.1:10958/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1430037000894808064)} 0 1
[junit4:junit4] 2> 25820 T808 C64 P10972 /update {update.distrib=FROMLEADER&_version_=-1430037000894808064&update.from=http://127.0.0.1:10958/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1430037000894808064)} 0 2
[junit4:junit4] 2> 25821 T778 C65 P10958 /update {wt=javabin&version=2} {deleteByQuery=*:* (-1430037000894808064)} 0 8
[junit4:junit4] 2> 25827 T755 C67 P10950 /update {wt=javabin&version=2} {add=[0 (1430037000905293824)]} 0 3
[junit4:junit4] 2> 25838 T808 C64 P10972 /update {distrib.from=http://127.0.0.1:10958/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1430037000911585280)]} 0 3
[junit4:junit4] 2> 25838 T825 C66 P10986 /update {distrib.from=http://127.0.0.1:10958/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1430037000911585280)]} 0 3
[junit4:junit4] 2> 25838 T791 C63 P10964 /update {distrib.from=http://127.0.0.1:10958/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1430037000911585280)]} 0 3
[junit4:junit4] 2> 25839 T778 C65 P10958 /update {wt=javabin&version=2} {add=[0 (1430037000911585280)]} 0 9
[junit4:junit4] 2> 25843 T755 C67 P10950 /update {wt=javabin&version=2} {add=[1 (1430037000924168192)]} 0 1
[junit4:junit4] 2> 25851 T825 C66 P10986 /update {distrib.from=http://127.0.0.1:10958/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1430037000928362496)]} 0 1
[junit4:junit4] 2> 25851 T791 C63 P10964 /update {distrib.from=http://127.0.0.1:10958/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1430037000928362496)]} 0 1
[junit4:junit4] 2> 25852 T808 C64 P10972 /update {distrib.from=http://127.0.0.1:10958/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1430037000928362496)]} 0 2
[junit4:junit4] 2> 25852 T778 C65 P10958 /update {wt=javabin&version=2} {add=[1 (1430037000928362496)]} 0 6
[junit4:junit4] 2> 25856 T755 C67 P10950 /update {wt=javabin&version=2} {add=[2 (1430037000937799680)]} 0 1
[junit4:junit4] 2> 25864 T808 C64 P10972 /update {distrib.from=http://127.0.0.1:10958/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1430037000943042560)]} 0 1
[junit4:junit4] 2> 25864 T825 C66 P10986 /update {distrib.from=http://127.0.0.1:10958/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1430037000943042560)]} 0 1
[junit4:junit4] 2> 25865 T778 C65 P10958 /update {test.distrib.skip.servers=http://127.0.0.1:10964/collection1/&wt=javabin&version=2} {add=[2 (1430037000943042560)]} 0 6
[junit4:junit4] 2> 25869 T755 C67 P10950 /update {wt=javabin&version=2} {add=[3 (1430037000951431168)]} 0 1
[junit4:junit4] 2> 25877 T825 C66 P10986 /update {distrib.from=http://127.0.0.1:10958/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1430037000955625472)]} 0 1
[junit4:junit4] 2> 25878 T778 C65 P10958 /update {test.distrib.skip.servers=http://127.0.0.1:10964/collection1/&test.distrib.skip.servers=http://127.0.0.1:10972/collection1/&wt=javabin&version=2} {add=[3 (1430037000955625472)]} 0 6
[junit4:junit4] 2> 25881 T755 C67 P10950 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 25934 T755 C67 P10950 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11bbd441; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/control/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@11bbd441; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip, segments_3]
[junit4:junit4] 2> 25935 T755 C67 P10950 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip, segments_3]
[junit4:junit4] 2> 25941 T755 C67 P10950 oass.SolrIndexSearcher.<init> Opening Searcher@31da0621 main
[junit4:junit4] 2> 25942 T755 C67 P10950 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 25943 T769 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@31da0621 main{StandardDirectoryReader(segments_3:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 25943 T755 C67 P10950 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 62
[junit4:junit4] 2> 25946 T778 C65 P10958 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 25994 T778 C65 P10958 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=5
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty1/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@36acd8f7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, segments_6, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4] 2> 25995 T778 C65 P10958 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, segments_6, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4] 2> 26001 T778 C65 P10958 oass.SolrIndexSearcher.<init> Opening Searcher@33e707c4 main
[junit4:junit4] 2> 26002 T778 C65 P10958 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 26003 T787 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@33e707c4 main{StandardDirectoryReader(segments_6:3:nrt _0(4.3):C4)}
[junit4:junit4] 2> 26003 T778 C65 P10958 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:10964/collection1/, StdNode: http://127.0.0.1:10972/collection1/, StdNode: http://127.0.0.1:10986/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 26006 T808 C64 P10972 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 26006 T825 C66 P10986 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 26007 T791 C63 P10964 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 26115 T808 C64 P10972 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@31674127; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty3/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@31674127; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, segments_5, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4] 2> 26115 T825 C66 P10986 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@556aa027; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5,filenames=[segments_5]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty4/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@556aa027; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_6,generation=6,filenames=[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, segments_6, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4] 2> 26115 T825 C66 P10986 oasc.SolrDeletionPolicy.updateCommits newest commit = 6[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, _0_Lucene41_0.tim, segments_6, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4] 2> 26115 T808 C64 P10972 oasc.SolrDeletionPolicy.updateCommits newest commit = 5[_0.fnm, _0_Lucene41_0.doc, _0_Lucene41_0.pos, _0_nrm.cfe, _0.fdx, _0_nrm.cfs, _0.si, segments_5, _0_Lucene41_0.tim, _0.fdt, _0_Lucene41_0.tip]
[junit4:junit4] 2> 26116 T791 C63 P10964 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f54aef4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1363789533454/jetty2/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@1f54aef4; maxCacheMB=48.0 maxMergeSizeMB=4.0),segF
[...truncated too long message...]
g... (live nodes size: 2)
[junit4:junit4] 2> 142740 T818 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 142740 T745 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4] 2> 142740 T818 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 142741 T743 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4] 2> 142742 T743 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4] 2> 142742 T743 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 142742 T743 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 142743 T743 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=F3334E0CFA380FF7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ko_KR -Dtests.timezone=Asia/Tbilisi -Dtests.file.encoding=US-ASCII
[junit4:junit4] FAILURE 143s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Test Setup Failure: shard1 should have just been set up to be inconsistent - but it's still consistent. Leader:http://127.0.0.1:10964/collection1 Dead Guy:http://127.0.0.1:10958/collection1skip list:[CloudJettyRunner [url=http://127.0.0.1:10972/collection1], CloudJettyRunner [url=http://127.0.0.1:10972/collection1]]
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([F3334E0CFA380FF7:72D5C0148D676FCB]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.junit.Assert.assertTrue(Assert.java:43)
[junit4:junit4] > at org.junit.Assert.assertNotNull(Assert.java:526)
[junit4:junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:212)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:601)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 142764 T743 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=ko_KR, timezone=Asia/Tbilisi
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=5,free=119895856,total=192937984
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestHashPartitioner, MBeansHandlerTest, CurrencyFieldOpenExchangeTest, ShowFileRequestHandlerTest, PeerSyncTest, SimpleFacetsTest, TestPHPSerializedResponseWriter, TestJmxMonitoredMap, TestSolrDeletionPolicy2, TestZkChroot, TestFastWriter, TestDynamicFieldResource, PathHierarchyTokenizerFactoryTest, TestDocSet, TestBinaryField, DirectSolrConnectionTest, RecoveryZkTest, OutputWriterTest, TestRecovery, ZkNodePropsTest, CacheHeaderTest, TestQuerySenderNoQuery, StatelessScriptUpdateProcessorFactoryTest, TestValueSourceCache, CoreAdminHandlerTest, FieldMutatingUpdateProcessorTest, TestFieldResource, TestJoin, TestFastLRUCache, UpdateParamsTest, SpellCheckComponentTest, QueryElevationComponentTest, DocumentBuilderTest, SpellCheckCollatorTest, TestFieldTypeCollectionResource, TestPartialUpdateDeduplication, TestLuceneMatchVersion, TestFunctionQuery, TestBinaryResponseWriter, TestCollationKeyRangeQueries, DateFieldTest, DOMUtilTest, TestRemoteStreaming, TestSweetSpotSimilarityFactory, ResponseLogComponentTest, TestOmitPositions, TestExtendedDismaxParser, IndexReaderFactoryTest, DocValuesTest, LegacyHTMLStripCharFilterTest, ExternalFileFieldSortTest, TestRangeQuery, SystemInfoHandlerTest, ShardRoutingCustomTest, TestPseudoReturnFields, TestSolrDiscoveryProperties, ZkCLITest, StatsComponentTest, SynonymTokenizerTest, SolrInfoMBeanTest, TestCSVResponseWriter, HighlighterConfigTest, StandardRequestHandlerTest, SyncSliceTest]
[junit4:junit4] Completed on J1 in 142.79s, 1 test, 1 failure <<< FAILURES!
[...truncated 561 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:381: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-java7/lucene/common-build.xml:877: There were test failures: 273 suites, 1147 tests, 1 failure, 27 ignored (8 assumptions)
Total time: 47 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure