You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/11/21 21:59:52 UTC
[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1776 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1776/
1 tests failed.
FAILED: org.apache.solr.cloud.DeleteInactiveReplicaTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:62460, http://127.0.0.1:37095]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:62460, http://127.0.0.1:37095]
at __randomizedtesting.SeedInfo.seed([FB8456D2A2946B66:7A62D8CAD5CB0B5A]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:354)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:138)
at org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest(DeleteInactiveReplicaTest.java:120)
at org.apache.solr.cloud.DeleteInactiveReplicaTest.doTest(DeleteInactiveReplicaTest.java:43)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: deletereplica the collection time out:60s
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:491)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:197)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:285)
... 45 more
Build Log:
[...truncated 10572 lines...]
[junit4] Suite: org.apache.solr.cloud.DeleteInactiveReplicaTest
[junit4] 2> 1904799 T5175 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 1904806 T5175 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-DeleteInactiveReplicaTest-1385067060677
[junit4] 2> 1904808 T5175 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1904809 T5176 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1904909 T5175 oasc.ZkTestServer.run start zk server on port:45812
[junit4] 2> 1904910 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1904915 T5182 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20f3de89 name:ZooKeeperConnection Watcher:127.0.0.1:45812 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1904916 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1904916 T5175 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1904931 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1904934 T5184 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@469aba03 name:ZooKeeperConnection Watcher:127.0.0.1:45812/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1904934 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1904934 T5175 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1904944 T5175 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1904948 T5175 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1904950 T5175 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1904959 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1904960 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1904973 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1904975 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1905079 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1905080 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1905083 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1905083 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1905087 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1905087 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1905090 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1905091 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1905094 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1905095 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1905097 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1905098 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1905107 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1905108 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1905110 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1905111 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1905114 T5175 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1905115 T5175 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1905445 T5175 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1905449 T5175 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37095
[junit4] 2> 1905449 T5175 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1905450 T5175 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1905450 T5175 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006
[junit4] 2> 1905451 T5175 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/'
[junit4] 2> 1905490 T5175 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/solr.xml
[junit4] 2> 1905587 T5175 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1905588 T5175 oasc.CoreContainer.<init> New CoreContainer 1626937214
[junit4] 2> 1905588 T5175 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/]
[junit4] 2> 1905590 T5175 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1905590 T5175 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1905591 T5175 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1905591 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1905592 T5175 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1905592 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1905593 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1905593 T5175 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1905594 T5175 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1905601 T5175 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1905602 T5175 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1905602 T5175 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1905603 T5175 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45812/solr
[junit4] 2> 1905603 T5175 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1905604 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1905607 T5195 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63458a7f name:ZooKeeperConnection Watcher:127.0.0.1:45812 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1905607 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1905621 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1905623 T5197 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@113a7f65 name:ZooKeeperConnection Watcher:127.0.0.1:45812/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1905624 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1905626 T5175 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1905634 T5175 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1905638 T5175 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1905644 T5175 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37095_
[junit4] 2> 1905646 T5175 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37095_
[junit4] 2> 1905653 T5175 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1905666 T5175 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1905673 T5175 oasc.Overseer.start Overseer (id=90771754889117699-127.0.0.1:37095_-n_0000000000) starting
[junit4] 2> 1905678 T5175 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1905691 T5199 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1905692 T5175 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1905694 T5175 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1905702 T5175 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1905704 T5198 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1905707 T5175 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006
[junit4] 2> 1905712 T5175 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/conf/
[junit4] 2> 1906062 T5175 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1906063 T5175 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1906064 T5175 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1906073 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1906075 T5202 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28b268de name:ZooKeeperConnection Watcher:127.0.0.1:45812/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1906075 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1906077 T5175 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1906079 T5175 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1906400 T5175 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1906403 T5175 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:23276
[junit4] 2> 1906404 T5175 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1906405 T5175 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1906405 T5175 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949
[junit4] 2> 1906406 T5175 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/'
[junit4] 2> 1906448 T5175 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/solr.xml
[junit4] 2> 1906541 T5175 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1906542 T5175 oasc.CoreContainer.<init> New CoreContainer 302503826
[junit4] 2> 1906542 T5175 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/]
[junit4] 2> 1906544 T5175 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1906545 T5175 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1906545 T5175 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1906546 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1906546 T5175 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1906547 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1906547 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1906548 T5175 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1906548 T5175 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1906555 T5175 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1906556 T5175 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1906556 T5175 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1906556 T5175 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45812/solr
[junit4] 2> 1906557 T5175 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1906558 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1906568 T5213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@747993fe name:ZooKeeperConnection Watcher:127.0.0.1:45812 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1906569 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1906591 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1906593 T5215 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c77c2ac name:ZooKeeperConnection Watcher:127.0.0.1:45812/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1906593 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1906604 T5175 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1907621 T5175 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:23276_
[junit4] 2> 1907634 T5175 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:23276_
[junit4] 2> 1907637 T5202 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1907637 T5197 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1907637 T5215 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1907656 T5175 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949
[junit4] 2> 1907664 T5175 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/conf/
[junit4] 2> 1907960 T5175 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1907961 T5175 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1907961 T5175 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1908282 T5175 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1908285 T5175 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:62460
[junit4] 2> 1908286 T5175 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1908286 T5175 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1908287 T5175 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385067063842
[junit4] 2> 1908287 T5175 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385067063842/'
[junit4] 2> 1908328 T5175 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385067063842/solr.xml
[junit4] 2> 1908428 T5175 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1908429 T5175 oasc.CoreContainer.<init> New CoreContainer 690585629
[junit4] 2> 1908429 T5175 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385067063842/]
[junit4] 2> 1908431 T5175 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1908432 T5175 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1908432 T5175 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1908432 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1908433 T5175 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1908433 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1908434 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1908434 T5175 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1908435 T5175 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1908443 T5175 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1908443 T5175 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1908444 T5175 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1908444 T5175 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45812/solr
[junit4] 2> 1908445 T5175 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1908446 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1908485 T5227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a164595 name:ZooKeeperConnection Watcher:127.0.0.1:45812 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1908485 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1908489 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1908491 T5229 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c716612 name:ZooKeeperConnection Watcher:127.0.0.1:45812/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1908491 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1908501 T5175 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1909505 T5175 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62460_
[junit4] 2> 1909517 T5175 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62460_
[junit4] 2> 1909520 T5197 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1909520 T5229 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1909520 T5215 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1909520 T5202 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1909538 T5175 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385067063842
[junit4] 2> 1909553 T5175 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385067063842/conf/
[junit4] 2> 1909856 T5175 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1909857 T5175 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1909858 T5175 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1910173 T5175 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1910177 T5175 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37759
[junit4] 2> 1910178 T5175 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1910178 T5175 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1910179 T5175 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735
[junit4] 2> 1910179 T5175 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/'
[junit4] 2> 1910222 T5175 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/solr.xml
[junit4] 2> 1910321 T5175 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1910322 T5175 oasc.CoreContainer.<init> New CoreContainer 987347251
[junit4] 2> 1910322 T5175 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/]
[junit4] 2> 1910324 T5175 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1910325 T5175 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1910325 T5175 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1910326 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1910326 T5175 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1910327 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1910327 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1910327 T5175 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1910328 T5175 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1910336 T5175 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1910337 T5175 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1910338 T5175 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1910338 T5175 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45812/solr
[junit4] 2> 1910339 T5175 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1910340 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1910342 T5241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ae8fde0 name:ZooKeeperConnection Watcher:127.0.0.1:45812 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1910343 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1910346 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1910355 T5243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1484f5fa name:ZooKeeperConnection Watcher:127.0.0.1:45812/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1910355 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1910360 T5175 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1911363 T5175 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37759_
[junit4] 2> 1911370 T5175 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37759_
[junit4] 2> 1911373 T5229 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1911373 T5197 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1911373 T5243 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1911373 T5215 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1911373 T5202 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1911380 T5175 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735
[junit4] 2> 1911563 T5175 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/conf/
[junit4] 2> 1911567 T5175 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1911568 T5175 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1911568 T5175 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1911874 T5175 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1911877 T5175 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:61961
[junit4] 2> 1911878 T5175 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1911879 T5175 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1911879 T5175 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445
[junit4] 2> 1911880 T5175 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/'
[junit4] 2> 1911921 T5175 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/solr.xml
[junit4] 2> 1912014 T5175 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1912015 T5175 oasc.CoreContainer.<init> New CoreContainer 34171002
[junit4] 2> 1912015 T5175 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/]
[junit4] 2> 1912017 T5175 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1912017 T5175 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1912018 T5175 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1912018 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1912019 T5175 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1912019 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1912020 T5175 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1912020 T5175 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1912021 T5175 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1912028 T5175 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1912028 T5175 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1912029 T5175 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1912029 T5175 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45812/solr
[junit4] 2> 1912030 T5175 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1912031 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1912064 T5255 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ceb81f8 name:ZooKeeperConnection Watcher:127.0.0.1:45812 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1912064 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1912068 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1912070 T5257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4080fc5e name:ZooKeeperConnection Watcher:127.0.0.1:45812/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1912071 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1912086 T5175 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1913089 T5175 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:61961_
[junit4] 2> 1913097 T5175 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:61961_
[junit4] 2> 1913101 T5197 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1913101 T5215 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1913101 T5257 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1913101 T5202 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1913101 T5243 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1913101 T5229 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1913107 T5175 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445
[junit4] 2> 1913415 T5175 oasc.CorePropertiesLocator.discoverUnder Found core conf in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/conf/
[junit4] 2> 1913421 T5175 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1913422 T5175 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
[junit4] 2> 1913423 T5175 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1913430 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1913433 T5260 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15931d66 name:ZooKeeperConnection Watcher:127.0.0.1:45812/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1913433 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1913434 T5175 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1913437 T5175 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1913439 T5262 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3dd824d2 name:ZooKeeperConnection Watcher:127.0.0.1:45812/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1913439 T5175 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1913441 T5175 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1913444 T5233 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&maxShardsPerNode=2&name=delDeadColl&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4] 2> 1913446 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1913447 T5199 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delDeadColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 1913448 T5199 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delDeadColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 1913458 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1913459 T5198 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1913460 T5198 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: delDeadColl
[junit4] 2> 1913460 T5198 oasc.Overseer$ClusterStateUpdater.createCollection Create collection delDeadColl with shards [shard1, shard2]
[junit4] 2> 1913464 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1913472 T5262 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913473 T5229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913473 T5197 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913473 T5260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913473 T5243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913473 T5202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913472 T5215 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913473 T5257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913559 T5199 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 1913559 T5199 oasc.OverseerCollectionProcessor.createCollection Creating shard delDeadColl_shard1_replica1 as part of slice shard1 of collection delDeadColl on 127.0.0.1:37095_
[junit4] 2> 1913560 T5199 oasc.OverseerCollectionProcessor.createCollection Creating shard delDeadColl_shard1_replica2 as part of slice shard1 of collection delDeadColl on 127.0.0.1:37759_
[junit4] 2> 1913561 T5199 oasc.OverseerCollectionProcessor.createCollection Creating shard delDeadColl_shard2_replica1 as part of slice shard2 of collection delDeadColl on 127.0.0.1:23276_
[junit4] 2> 1913562 T5199 oasc.OverseerCollectionProcessor.createCollection Creating shard delDeadColl_shard2_replica2 as part of slice shard2 of collection delDeadColl on 127.0.0.1:61961_
[junit4] 2> 1913565 T5234 oasc.ZkController.publish publishing core=delDeadColl_shard1_replica2 state=down
[junit4] 2> 1913566 T5205 oasc.ZkController.publish publishing core=delDeadColl_shard2_replica1 state=down
[junit4] 2> 1913567 T5187 oasc.ZkController.publish publishing core=delDeadColl_shard1_replica1 state=down
[junit4] 2> 1913567 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1913567 T5247 oasc.ZkController.publish publishing core=delDeadColl_shard2_replica2 state=down
[junit4] 2> 1913567 T5234 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1913568 T5205 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1913579 T5187 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1913580 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1913580 T5247 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1913580 T5198 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1913581 T5198 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37759",
[junit4] 2> "core":"delDeadColl_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37759_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delDeadColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1913584 T5198 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:23276",
[junit4] 2> "core":"delDeadColl_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:23276_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delDeadColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1913587 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1913588 T5198 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37095",
[junit4] 2> "core":"delDeadColl_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37095_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delDeadColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1913590 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1913591 T5198 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:61961",
[junit4] 2> "core":"delDeadColl_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:61961_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delDeadColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1913593 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1913695 T5202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913696 T5229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913696 T5243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913696 T5257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913696 T5260 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913695 T5215 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913695 T5197 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1913695 T5262 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1914569 T5234 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delDeadColl_shard1_replica2
[junit4] 2> 1914570 T5205 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delDeadColl_shard2_replica1
[junit4] 2> 1914571 T5234 oasc.CoreContainer.create Creating SolrCore 'delDeadColl_shard1_replica2' using instanceDir: ./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/delDeadColl_shard1_replica2
[junit4] 2> 1914572 T5234 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delDeadColl
[junit4] 2> 1914572 T5234 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delDeadColl
[junit4] 2> 1914573 T5205 oasc.CoreContainer.create Creating SolrCore 'delDeadColl_shard2_replica1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/delDeadColl_shard2_replica1
[junit4] 2> 1914573 T5234 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 1914573 T5205 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delDeadColl
[junit4] 2> 1914574 T5234 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 1914574 T5205 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delDeadColl
[junit4] 2> 1914575 T5234 oascc.SolrZkClient.makePath makePath: /collections/delDeadColl
[junit4] 2> 1914575 T5205 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 1914577 T5205 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 1914577 T5234 oasc.ZkController.readConfigName Load collection config from:/collections/delDeadColl
[junit4] 2> 1914578 T5205 oascc.SolrZkClient.makePath makePath: /collections/delDeadColl
[junit4] 2> 1914579 T5234 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/delDeadColl_shard1_replica2/'
[junit4] 2> 1914580 T5205 oasc.ZkController.readConfigName Load collection config from:/collections/delDeadColl
[junit4] 2> 1914581 T5187 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delDeadColl_shard1_replica1
[junit4] 2> 1914581 T5205 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/delDeadColl_shard2_replica1/'
[junit4] 2> 1914581 T5247 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delDeadColl_shard2_replica2
[junit4] 2> 1914584 T5187 oasc.CoreContainer.create Creating SolrCore 'delDeadColl_shard1_replica1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/delDeadColl_shard1_replica1
[junit4] 2> 1914585 T5187 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delDeadColl
[junit4] 2> 1914585 T5247 oasc.CoreContainer.create Creating SolrCore 'delDeadColl_shard2_replica2' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/delDeadColl_shard2_replica2
[junit4] 2> 1914585 T5187 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1914585 T5247 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delDeadColl
[junit4] 2> 1914586 T5187 oasc.ZkController.readConfigName Load collection config from:/collections/delDeadColl
[junit4] 2> 1914587 T5247 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1914587 T5247 oasc.ZkController.readConfigName Load collection config from:/collections/delDeadColl
[junit4] 2> 1914587 T5187 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/delDeadColl_shard1_replica1/'
[junit4] 2> 1914588 T5247 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/delDeadColl_shard2_replica2/'
[junit4] 2> 1914734 T5205 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1914735 T5247 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1914734 T5187 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1914736 T5234 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 1914838 T5205 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1914839 T5247 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1914839 T5187 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1914839 T5234 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1914940 T5205 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1914941 T5247 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1914941 T5234 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1914941 T5187 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1914954 T5205 oass.IndexSchema.readSchema [delDeadColl_shard2_replica1] Schema name=test
[junit4] 2> 1914955 T5187 oass.IndexSchema.readSchema [delDeadColl_shard1_replica1] Schema name=test
[junit4] 2> 1914955 T5247 oass.IndexSchema.readSchema [delDeadColl_shard2_replica2] Schema name=test
[junit4] 2> 1914955 T5234 oass.IndexSchema.readSchema [delDeadColl_shard1_replica2] Schema name=test
[junit4] 2> 1915848 T5187 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1915848 T5247 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1915849 T5205 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1915849 T5187 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1915850 T5205 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1915849 T5247 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1915851 T5187 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1915852 T5247 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1915851 T5205 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1915856 T5234 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1915856 T5234 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 1915857 T5234 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1915865 T5187 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1915866 T5205 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1915867 T5247 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1915868 T5234 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1915871 T5187 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1915871 T5205 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1915872 T5247 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1915873 T5234 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1915887 T5234 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1915887 T5205 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1915887 T5247 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1915887 T5187 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1915893 T5234 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1915894 T5205 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1915894 T5187 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1915894 T5247 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1915898 T5234 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1915900 T5205 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1915900 T5187 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1915900 T5234 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1915901 T5205 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1915900 T5247 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1915901 T5205 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1915901 T5187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1915903 T5247 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1915901 T5234 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1915903 T5247 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1915903 T5187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1915902 T5205 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1915905 T5187 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1915904 T5247 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1915904 T5234 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1915906 T5187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1915907 T5247 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1915906 T5205 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1915907 T5247 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1915907 T5234 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1915907 T5187 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1915908 T5234 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1915908 T5247 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1915908 T5205 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1915910 T5247 oasc.SolrCore.<init> [delDeadColl_shard2_replica2] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/delDeadColl_shard2_replica2/, dataDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/delDeadColl_shard2_replica2/data/
[junit4] 2> 1915909 T5234 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1915909 T5187 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1915911 T5234 oasc.SolrCore.<init> [delDeadColl_shard1_replica2] Opening new SolrCore at ./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/delDeadColl_shard1_replica2/, dataDir=./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/delDeadColl_shard1_replica2/data/
[junit4] 2> 1915911 T5247 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@836465
[junit4] 2> 1915910 T5205 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1915912 T5234 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@836465
[junit4] 2> 1915911 T5187 oasc.SolrCore.<init> [delDeadColl_shard1_replica1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/delDeadColl_shard1_replica1/, dataDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/delDeadColl_shard1_replica1/data/
[junit4] 2> 1915913 T5247 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/delDeadColl_shard2_replica2/data
[junit4] 2> 1915913 T5205 oasc.SolrCore.<init> [delDeadColl_shard2_replica1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/delDeadColl_shard2_replica1/, dataDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/delDeadColl_shard2_replica1/data/
[junit4] 2> 1915914 T5247 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/delDeadColl_shard2_replica2/data/index/
[junit4] 2> 1915914 T5234 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/delDeadColl_shard1_replica2/data
[junit4] 2> 1915913 T5187 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@836465
[junit4] 2> 1915915 T5234 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/delDeadColl_shard1_replica2/data/index/
[junit4] 2> 1915915 T5247 oasc.SolrCore.initIndex WARN [delDeadColl_shard2_replica2] Solr index directory '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/delDeadColl_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1915914 T5205 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@836465
[junit4] 2> 1915916 T5187 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/delDeadColl_shard1_replica1/data
[junit4] 2> 1915916 T5234 oasc.SolrCore.initIndex WARN [delDeadColl_shard1_replica2] Solr index directory './org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/delDeadColl_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1915917 T5187 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/delDeadColl_shard1_replica1/data/index/
[junit4] 2> 1915918 T5205 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/delDeadColl_shard2_replica1/data
[junit4] 2> 1915918 T5247 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385067067445/delDeadColl_shard2_replica2/data/index
[junit4] 2> 1915918 T5187 oasc.SolrCore.initIndex WARN [delDeadColl_shard1_replica1] Solr index directory '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/delDeadColl_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1915919 T5234 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385067065735/delDeadColl_shard1_replica2/data/index
[junit4] 2> 1915919 T5247 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=67.892578125, floorSegmentMB=0.3251953125, forceMergeDeletesPctAllowed=1.9351408177052565, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1915918 T5205 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/delDeadColl_shard2_replica1/data/index/
[junit4] 2> 1915920 T5234 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=67.892578125, floorSegmentMB=0.3251953125, forceMergeDeletesPctAllowed=1.9351408177052565, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1915921 T5187 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385067061006/delDeadColl_shard1_replica1/data/index
[junit4] 2> 1915921 T5205 oasc.SolrCore.initIndex WARN [delDeadColl_shard2_replica1] Solr index directory '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/delDeadColl_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1915922 T5187 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=67.892578125, floorSegmentMB=0.3251953125, forceMergeDeletesPctAllowed=1.9351408177052565, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1915923 T5247 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/index5892458926tmp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3da69e3c),segFN=segments_1,generation=1}
[junit4] 2> 1915924 T5247 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1915924 T5234 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/index5892458927tmp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5de94c3),segFN=segments_1,generation=1}
[junit4] 2> 1915924 T5205 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385067061949/delDeadColl_shard2_replica1/data/index
[junit4] 2> 1915925 T5234 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1915925 T5205 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=67.892578125, floorSegmentMB=0.3251953125, forceMergeDeletesPctAllowed=1.9351408177052565, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1915926 T5187 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/index5892458928tmp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@440db4b3),segFN=segments_1,generation=1}
[junit4] 2> 1915926 T5187 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1915928 T5247 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1915929 T5247 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1915929 T5205 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/index5892458929tmp lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@35ae3e55),segFN=segments_1,generation=1}
[junit4] 2> 1915929 T5247 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1915929 T5234 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1915930 T5247 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1915931 T5187 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1915929 T5205 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1915931 T5187 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1915931 T5247 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1915930 T5234 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1915932 T5247 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1915932 T5187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1915934 T5247 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1915934 T5187 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1915933 T5234 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1915934 T5187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1915934 T5247 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1915935 T5187 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1915935 T5205 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1915936 T5187 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1915935 T5234 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1915937 T5187 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1915937 T5205 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1915936 T5247 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1915938 T5205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1915938 T5187 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1915937 T5234 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1915940 T5187 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1915939 T5205 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1915940 T5187 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1915941 T5187 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1915939 T5247 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1915941 T5187 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1915942 T5247 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1915942 T5187 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1915941 T5205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1915940 T5234 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1915943 T5205 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1915944 T5234 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1915944 T5205 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1915943 T5187 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1915942 T5247 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1915946 T5187 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1915946 T5247 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1915945 T5205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1915947 T5247 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1915945 T5234 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1915947 T5247 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1915947 T5205 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1915948 T5247 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1915948 T5234 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1915949 T5205 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1915950 T5234 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1915950 T5205 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1915950 T5234 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1915951 T5234 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1915951 T5205 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1915951 T5234 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1915952 T5205 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1915952 T5234 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1915953 T5205 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1915953 T5234 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1915954 T5205 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1915954 T5234 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1915955 T5205 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1915980 T5187 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1915980 T5205 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1915982 T5234 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1915987 T5247 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1916001 T5205 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1916002 T5187 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1916002 T5205 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1916003 T5234 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1916003 T5187 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1916004 T5205 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1213738744, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1916004 T5234 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1916005 T5187 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1213738744, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.79
[...truncated too long message...]
ss(LeaderElector.java:165)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:109)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:138)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:304)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:301)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:301)
[junit4] 2> at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:1034)
[junit4] 2> ... 48 more
[junit4] 2>
[junit4] 2> 2161926 T5197 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2161926 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2161926 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2161926 T5197 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work/qnr-0000000004 state: SyncConnected type NodeDeleted
[junit4] 2> 2175457 T5289 oasc.SolrException.log ERROR Collection deletereplica of deletereplica failed:java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeGone(OverseerCollectionProcessor.java:321)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.deleteReplica(OverseerCollectionProcessor.java:309)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:249)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:175)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2>
[junit4] 2> 2175458 T5229 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2175458 T5262 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2175460 T5175 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4] 2> 2175462 T5289 oasc.OverseerCollectionProcessor.run WARN Overseer cannot talk to ZK
[junit4] 2> 2175513 T5175 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 37759
[junit4] 2> 2175513 T5175 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 61961
[junit4] 2> 2175519 T5175 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 2175521 T5175 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45812 45812
[junit4] 2> 2175686 T5262 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3dd824d2 name:ZooKeeperConnection Watcher:127.0.0.1:45812/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 2175686 T5262 oascc.ConnectionManager.process Client->ZooKeeper status change trigger but we are already closed
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DeleteInactiveReplicaTest -Dtests.method=testDistribSearch -Dtests.seed=FB8456D2A2946B66 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr_RS_#Latn -Dtests.timezone=HST -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 271s J0 | DeleteInactiveReplicaTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:62460, http://127.0.0.1:37095]
[junit4] > at __randomizedtesting.SeedInfo.seed([FB8456D2A2946B66:7A62D8CAD5CB0B5A]:0)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:354)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
[junit4] > at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:138)
[junit4] > at org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest(DeleteInactiveReplicaTest.java:120)
[junit4] > at org.apache.solr.cloud.DeleteInactiveReplicaTest.doTest(DeleteInactiveReplicaTest.java:43)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: deletereplica the collection time out:60s
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:491)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:197)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:285)
[junit4] > ... 45 more
[junit4] 2> 2175707 T5175 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 270913 T5174 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=sr_RS_#Latn, timezone=HST
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=2,free=209575472,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrXmlPersistence, LukeRequestHandlerTest, TestFieldResource, TestFastLRUCache, ClusterStateTest, SuggesterFSTTest, StatsComponentTest, TestLazyCores, TestQueryUtils, TestZkChroot, TestIBSimilarityFactory, TestXIncludeConfig, SliceStateUpdateTest, TestFastWriter, PreAnalyzedUpdateProcessorTest, TestRandomDVFaceting, HardAutoCommitTest, TestDistributedGrouping, TestRTGBase, SolrCmdDistributorTest, FileUtilsTest, TestUniqueKeyFieldResource, AddSchemaFieldsUpdateProcessorFactoryTest, TestSchemaNameResource, SchemaVersionSpecificBehaviorTest, TestReplicationHandler, DistributedTermsComponentTest, BadIndexSchemaTest, TestFieldTypeResource, TestAnalyzeInfixSuggestions, TriLevelCompositeIdRoutingTest, DirectSolrConnectionTest, FileBasedSpellCheckerTest, TestSystemIdResolver, TestElisionMultitermQuery, TestPartialUpdateDeduplication, TestNoOpRegenerator, HdfsSyncSliceTest, BasicDistributedZkTest, TestFastOutputStream, SortByFunctionTest, TestDistribDocBasedVersion, SolrCoreCheckLockOnStartupTest, TestImplicitCoreProperties, SuggesterWFSTTest, TestRealTimeGet, PreAnalyzedFieldTest, SpatialFilterTest, TestSchemaResource, TermsComponentTest, DirectSolrSpellCheckerTest, TestDocBasedVersionConstraints, UniqFieldsUpdateProcessorFactoryTest, TestCloudManagedSchemaAddField, PrimUtilsTest, TestFiltering, SignatureUpdateProcessorFactoryTest, ChangedSchemaMergeTest, StandardRequestHandlerTest, TestIndexingPerformance, TestAnalyzedSuggestions, TestTrie, TermVectorComponentDistributedTest, ShardRoutingTest, RecoveryZkTest, HdfsBasicDistributedZk2Test, NotRequiredUniqueKeyTest, URLClassifyProcessorTest, ResponseLogComponentTest, TestPerFieldSimilarity, TestNonNRTOpen, TestCollapseQParserPlugin, ExternalFileFieldSortTest, SpellingQueryConverterTest, ModifyConfFileTest, TestSchemaVersionResource, SpellCheckCollatorTest, LeaderElectionTest, DocValuesMissingTest, AutoCommitTest, TestNumberUtils, BasicDistributedZk2Test, ShardSplitTest, CustomCollectionTest, OverseerTest, TestRecovery, DeleteInactiveReplicaTest]
[junit4] Completed on J0 in 271.48s, 1 test, 1 error <<< FAILURES!
[...truncated 451 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:426: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:406: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:489: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1276: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:912: There were test failures: 341 suites, 1498 tests, 1 error, 34 ignored (6 assumptions)
Total time: 67 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure