You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/28 18:19:58 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_20-ea-b15) -
Build # 10408 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10408/
Java: 64bit/jdk1.8.0_20-ea-b15 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard2 is not consistent. Got 147 from https://127.0.0.1:42633/rqc/v/collection1lastClient and got 140 from https://127.0.0.1:53388/rqc/v/collection1
Stack Trace:
java.lang.AssertionError: shard2 is not consistent. Got 147 from https://127.0.0.1:42633/rqc/v/collection1lastClient and got 140 from https://127.0.0.1:53388/rqc/v/collection1
at __randomizedtesting.SeedInfo.seed([1A82F1A60F576D8:804EA10217AA16E4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1131)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1110)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.handler.TestReplicationHandler.doTestBackup
Error Message:
Could not remove the following files (in the order of attempts): /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/snapshot.vgachumtyoimf/_0.cfe /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/snapshot.vgachumtyoimf
Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/snapshot.vgachumtyoimf/_0.cfe
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/snapshot.vgachumtyoimf
at __randomizedtesting.SeedInfo.seed([1A82F1A60F576D8:40230F7F474B8597]:0)
at org.apache.lucene.util.TestUtil.rm(TestUtil.java:118)
at org.apache.solr.handler.TestReplicationHandler.doTestBackup(TestReplicationHandler.java:1554)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10907 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/init-core-data-001
[junit4] 2> 254177 T1222 oas.SolrTestCaseJ4.setUp ###Starting doTestReplicateAfterCoreReload
[junit4] 2> 254181 T1222 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 254188 T1222 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51596
[junit4] 2> 254189 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 254189 T1222 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 254190 T1222 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001
[junit4] 2> 254190 T1222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/'
[junit4] 2> 254203 T1222 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/solr.xml
[junit4] 2> 254213 T1222 oasc.CoreContainer.<init> New CoreContainer 1485940037
[junit4] 2> 254213 T1222 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/]
[junit4] 2> 254214 T1222 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 254214 T1222 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 254215 T1222 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 254215 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 254215 T1222 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 254216 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 254216 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 254216 T1222 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 254216 T1222 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 254217 T1222 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 254218 T1222 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 254218 T1222 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 254221 T1232 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/'
[junit4] 2> 254249 T1232 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 254258 T1232 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 254258 T1232 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 254260 T1232 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 254263 T1232 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 254263 T1232 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/
[junit4] 2> 254263 T1232 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 254263 T1232 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/
[junit4] 2> 254264 T1232 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 254264 T1232 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data
[junit4] 2> 254264 T1232 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index/
[junit4] 2> 254264 T1232 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 254264 T1232 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index
[junit4] 2> 254265 T1232 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 254265 T1232 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@77ea6145 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26628f3e),segFN=segments_1,generation=1}
[junit4] 2> 254266 T1232 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 254267 T1232 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 254267 T1232 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 254267 T1232 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 254267 T1232 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 254267 T1232 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 254268 T1232 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 254268 T1232 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 254270 T1232 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 254271 T1232 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 254271 T1232 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 254271 T1232 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=3, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5365425318819433]
[junit4] 2> 254272 T1232 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@77ea6145 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@26628f3e),segFN=segments_1,generation=1}
[junit4] 2> 254272 T1232 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 254272 T1232 oass.SolrIndexSearcher.<init> Opening Searcher@6d24c2e4[collection1] main
[junit4] 2> 254272 T1232 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf
[junit4] 2> 254273 T1232 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf/}
[junit4] 2> 254273 T1232 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf
[junit4] 2> 254273 T1232 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 254274 T1232 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 254274 T1232 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 254274 T1232 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 254274 T1232 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 254274 T1233 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d24c2e4[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 254274 T1232 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 254275 T1222 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 254275 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 254280 T1222 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 254282 T1222 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56320
[junit4] 2> 254283 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 254283 T1222 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 254283 T1222 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002
[junit4] 2> 254283 T1222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/'
[junit4] 2> 254291 T1222 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/solr.xml
[junit4] 2> 254308 T1222 oasc.CoreContainer.<init> New CoreContainer 1518925106
[junit4] 2> 254309 T1222 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/]
[junit4] 2> 254309 T1222 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 254309 T1222 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 254309 T1222 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 254310 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 254310 T1222 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 254310 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 254310 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 254310 T1222 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 254311 T1222 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 254311 T1222 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 254311 T1222 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 254312 T1222 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 254313 T1244 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/'
[junit4] 2> 254326 T1244 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 254341 T1244 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 254341 T1244 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 254343 T1244 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 254345 T1244 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 254345 T1244 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/
[junit4] 2> 254346 T1244 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 254346 T1244 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/
[junit4] 2> 254346 T1244 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 254346 T1244 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data
[junit4] 2> 254347 T1244 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index/
[junit4] 2> 254347 T1244 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 254347 T1244 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index
[junit4] 2> 254347 T1244 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 254348 T1244 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@628edc58 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@69b3d201),segFN=segments_1,generation=1}
[junit4] 2> 254348 T1244 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 254349 T1244 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 254349 T1244 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 254349 T1244 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 254349 T1244 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 254349 T1244 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 254350 T1244 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 254350 T1244 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 254351 T1244 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 254351 T1244 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 254352 T1244 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 254352 T1244 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=3, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5365425318819433]
[junit4] 2> 254352 T1244 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@628edc58 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@69b3d201),segFN=segments_1,generation=1}
[junit4] 2> 254353 T1244 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 254353 T1244 oass.SolrIndexSearcher.<init> Opening Searcher@753b3ed8[collection1] main
[junit4] 2> 254353 T1244 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/conf
[junit4] 2> 254354 T1244 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/conf/}
[junit4] 2> 254354 T1244 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/conf
[junit4] 2> 254354 T1244 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 254354 T1244 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 254355 T1244 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 254356 T1244 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4] 2> 254357 T1244 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 254357 T1245 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@753b3ed8[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 254357 T1222 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 254357 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 254380 T1222 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1518925106
[junit4] 2> 254381 T1222 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@7f7c6df2
[junit4] 2> 254381 T1222 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 254382 T1222 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 254382 T1222 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 254382 T1222 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 254383 T1222 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 254383 T1222 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 254384 T1222 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index;done=false>>]
[junit4] 2> 254384 T1222 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index
[junit4] 2> 254385 T1222 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data;done=false>>]
[junit4] 2> 254385 T1222 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data
[junit4] 2> 254386 T1222 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 254437 T1222 oejut.QueuedThreadPool.doStop WARN 3 threads could not be stopped
[junit4] 2> 254460 T1222 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1485940037
[junit4] 2> 254461 T1222 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@78276b15
[junit4] 2> 254462 T1222 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 254462 T1222 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 254462 T1222 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 254463 T1222 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 254464 T1222 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 254464 T1222 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 254464 T1222 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index;done=false>>]
[junit4] 2> 254465 T1222 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index
[junit4] 2> 254465 T1222 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data;done=false>>]
[junit4] 2> 254465 T1222 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data
[junit4] 2> 254466 T1222 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 254519 T1222 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 254521 T1222 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:45454
[junit4] 2> 254521 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 254522 T1222 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 254522 T1222 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001
[junit4] 2> 254522 T1222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/'
[junit4] 2> 254532 T1222 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/solr.xml
[junit4] 2> 254549 T1222 oasc.CoreContainer.<init> New CoreContainer 343475696
[junit4] 2> 254550 T1222 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/]
[junit4] 2> 254550 T1222 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 254551 T1222 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 254551 T1222 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 254551 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 254551 T1222 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 254551 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 254552 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 254552 T1222 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 254552 T1222 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 254553 T1222 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 254553 T1222 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 254553 T1222 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 254554 T1257 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/'
[junit4] 2> 254574 T1257 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 254584 T1257 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 254585 T1257 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 254588 T1257 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 254601 T1257 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 254602 T1257 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/
[junit4] 2> 254602 T1257 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 254602 T1257 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/
[junit4] 2> 254602 T1257 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 254603 T1257 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data
[junit4] 2> 254603 T1257 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index/
[junit4] 2> 254603 T1257 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 254603 T1257 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index
[junit4] 2> 254604 T1257 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 254604 T1257 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@78b4f1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@38ea31d3),segFN=segments_1,generation=1}
[junit4] 2> 254605 T1257 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 254605 T1257 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 254606 T1257 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 254606 T1257 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 254606 T1257 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 254606 T1257 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 254606 T1257 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 254607 T1257 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 254611 T1257 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 254612 T1257 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 254613 T1257 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 254613 T1257 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=3, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5365425318819433]
[junit4] 2> 254614 T1257 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@78b4f1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@38ea31d3),segFN=segments_1,generation=1}
[junit4] 2> 254614 T1257 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 254614 T1257 oass.SolrIndexSearcher.<init> Opening Searcher@43fa90a2[collection1] main
[junit4] 2> 254614 T1257 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf
[junit4] 2> 254615 T1257 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf/}
[junit4] 2> 254615 T1257 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf
[junit4] 2> 254615 T1257 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 254616 T1257 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 254616 T1257 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 254616 T1257 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml
[junit4] 2> 254616 T1257 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 254617 T1258 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@43fa90a2[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 254617 T1257 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 254617 T1222 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 254618 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> ASYNC NEW_CORE C456 name=collection1 org.apache.solr.core.SolrCore@59d675b5
[junit4] 2> 254620 T1253 C456 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 254621 T1253 C456 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 1
[junit4] 2> 254623 T1254 C456 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 254625 T1254 C456 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@78b4f1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@38ea31d3),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@78b4f1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@38ea31d3),segFN=segments_2,generation=2}
[junit4] 2> 254625 T1254 C456 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 254626 T1254 C456 oass.SolrIndexSearcher.<init> Opening Searcher@1fd9917[collection1] main
[junit4] 2> 254626 T1254 C456 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 254626 T1258 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1fd9917[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 254627 T1254 C456 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 4
[junit4] 2> 254634 T1255 C456 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=5
[junit4] 2> 254636 T1222 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 254637 T1222 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56032
[junit4] 2> 254638 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 254638 T1222 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 254638 T1222 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002
[junit4] 2> 254638 T1222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/'
[junit4] 2> 254645 T1222 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/solr.xml
[junit4] 2> 254653 T1222 oasc.CoreContainer.<init> New CoreContainer 1280090340
[junit4] 2> 254653 T1222 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/]
[junit4] 2> 254654 T1222 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 254654 T1222 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 254654 T1222 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 254655 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 254655 T1222 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 254655 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 254655 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 254655 T1222 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 254656 T1222 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 254656 T1222 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 254656 T1222 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 254656 T1222 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 254658 T1269 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/'
[junit4] 2> 254670 T1269 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 254684 T1269 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 254684 T1269 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 254686 T1269 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 254689 T1269 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 254689 T1269 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/
[junit4] 2> 254689 T1269 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 254690 T1269 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/
[junit4] 2> 254690 T1269 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 254690 T1269 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data
[junit4] 2> 254690 T1269 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index/
[junit4] 2> 254691 T1269 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 254691 T1269 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index
[junit4] 2> 254691 T1269 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 254692 T1269 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6f140147 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6d06a1bb),segFN=segments_1,generation=1}
[junit4] 2> 254692 T1269 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 254693 T1269 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 254693 T1269 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 254693 T1269 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 254693 T1269 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 254693 T1269 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 254693 T1269 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 254694 T1269 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 254695 T1269 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 254695 T1269 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 254695 T1269 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 254696 T1269 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=3, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5365425318819433]
[junit4] 2> 254696 T1269 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6f140147 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6d06a1bb),segFN=segments_1,generation=1}
[junit4] 2> 254696 T1269 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 254697 T1269 oass.SolrIndexSearcher.<init> Opening Searcher@52b160b5[collection1] main
[junit4] 2> 254697 T1269 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/conf
[junit4] 2> 254697 T1269 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/conf/}
[junit4] 2> 254697 T1269 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/conf
[junit4] 2> 254698 T1269 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 254698 T1269 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 254698 T1269 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 254699 T1269 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4] 2> 254699 T1269 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 254699 T1270 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@52b160b5[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 254701 T1222 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 254701 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> ASYNC NEW_CORE C457 name=collection1 org.apache.solr.core.SolrCore@519f1025
[junit4] 2> 254703 T1265 C457 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C458 name=collection1 org.apache.solr.core.SolrCore@59d675b5
[junit4] 2> 254706 T1256 C458 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=getIndexVersion&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=1
[junit4] 2> 254708 T1253 C458 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=getCommits&qt=/replication&wt=javabin&version=2&command=commits} status=0 QTime=0
[junit4] 2> 254710 T1254 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/'
[junit4] 2> 254726 T1254 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 254741 T1254 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 254742 T1254 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 254744 T1254 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 254746 T1254 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 254747 T1254 oasc.CoreContainer.reload Reloading SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/
[junit4] 2> 254747 T1254 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/
[junit4] 2> 254747 T1254 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 254748 T1254 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index/
[junit4] 2> 254748 T1254 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 254749 T1254 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 254749 T1254 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 254749 T1254 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 254750 T1254 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 254750 T1254 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 254750 T1254 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 254751 T1254 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 254752 T1254 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 254753 T1254 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 254753 T1254 oass.SolrIndexSearcher.<init> Opening Searcher@13afdf68[collection1] main
[junit4] 2> 254753 T1254 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf
[junit4] 2> 254754 T1254 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf/}
[junit4] 2> 254754 T1254 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf
[junit4] 2> 254755 T1254 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 254755 T1254 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 254755 T1254 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 254755 T1254 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml
[junit4] 2> 254756 T1254 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 254756 T1254 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4] 2> 254756 T1254 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 254756 T1254 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4] 2> 254756 T1273 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13afdf68[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 254757 T1254 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.33149920745268063]
[junit4] 2> 254758 T1254 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@78b4f1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@38ea31d3),segFN=segments_2,generation=2}
[junit4] 2> 254759 T1254 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 254759 T1254 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 254759 T1254 oass.SolrIndexSearcher.<init> Opening Searcher@15624294[collection1] main
[junit4] 2> 254759 T1254 oasc.CoreContainer.registerCore replacing core: collection1
[junit4] 2> 254759 T1254 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@59d675b5
[junit4] 2> 254759 T1273 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15624294[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 254760 T1254 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4] 2> 254760 T1254 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 254761 T1254 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={core=collection1&qt=/admin/cores&action=reload&wt=javabin&version=2} status=0 QTime=51
[junit4] 2> ASYNC NEW_CORE C459 name=collection1 org.apache.solr.core.SolrCore@2bc5e0d
[junit4] 2> 254763 T1255 C459 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=getIndexVersion&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 254765 T1256 C459 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=getCommits&qt=/replication&wt=javabin&version=2&command=commits} status=0 QTime=0
[junit4] 2> 254768 T1253 C459 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 1
[junit4] 2> 254770 T1254 C459 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
[junit4] 2> 254772 T1255 C459 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 254776 T1255 C459 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@78b4f1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@38ea31d3),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@78b4f1c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@38ea31d3),segFN=segments_3,generation=3}
[junit4] 2> 254776 T1255 C459 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 254778 T1255 C459 oass.SolrIndexSearcher.<init> Opening Searcher@3c85a1ef[collection1] main
[junit4] 2> 254779 T1255 C459 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 254779 T1273 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3c85a1ef[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):c2))}
[junit4] 2> 254779 T1255 C459 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 7
[junit4] 2> 254782 T1256 C459 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=2 status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C460 name=collection1 org.apache.solr.core.SolrCore@519f1025
[junit4] 2> 254785 T1266 C460 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 254785 T1222 oash.TestReplicationHandler.rQuery Waiting for 2 docs
[junit4] 2> 254822 T1253 C459 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 254823 T1271 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4] 2> 254823 T1271 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4] 2> 254823 T1271 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4] 2> 254827 T1254 C459 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=2
[junit4] 2> 254828 T1271 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 4
[junit4] 2> 254828 T1271 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index.20140528105734008
[junit4] 2> 254829 T1271 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4] 2> 254829 T1271 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 254829 T1271 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 254829 T1271 oash.SnapPuller.fetchLatestIndex Starting download to MockDirectoryWrapper(RAMDirectory@6f01711e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b63bc6f) fullCopy=false
[junit4] 2> 254831 T1255 C459 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_0.cfe&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 254834 T1256 C459 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 254837 T1253 C459 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=_0.cfs&checksum=true&wt=filestream&command=filecontent} status=0 QTime=1
[junit4] 2> 254840 T1254 C459 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=3&qt=/replication&file=segments_3&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 254841 T1271 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4] 2> 254842 T1271 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4] 2> 254842 T1271 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=48, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6505732769738707]
[junit4] 2> 254843 T1271 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6f140147 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6d06a1bb),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6f140147 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6d06a1bb),segFN=segments_3,generation=3}
[junit4] 2> 254843 T1271 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 254844 T1271 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 254844 T1271 oass.SolrIndexSearcher.<init> Opening Searcher@2dd63e22[collection1] main
[junit4] 2> 254845 T1270 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2dd63e22[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):c2))}
[junit4] 2> 254845 T1271 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index.20140528105734008 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index.20140528105734008;done=true>>]
[junit4] 2> 254845 T1271 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index.20140528105734008
[junit4] 2> 254888 T1267 C460 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=2 status=0 QTime=1
[junit4] 2> 254889 T1222 oas.SolrTestCaseJ4.tearDown ###Ending doTestReplicateAfterCoreReload
[junit4] 2> 254911 T1222 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=343475696
[junit4] 2> 254912 T1222 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@2bc5e0d
[junit4] 2> 254912 T1222 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 254913 T1222 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 254913 T1222 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 254914 T1222 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 254914 T1222 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 254915 T1222 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 254915 T1222 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data;done=false>>]
[junit4] 2> 254916 T1222 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data
[junit4] 2> 254916 T1222 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index;done=false>>]
[junit4] 2> 254916 T1222 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index
[junit4] 2> 254917 T1222 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 254990 T1222 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1280090340
[junit4] 2> 254990 T1222 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@519f1025
[junit4] 2> 254991 T1222 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 254991 T1222 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 254992 T1222 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 254992 T1222 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 254992 T1222 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 254993 T1222 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 254993 T1222 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data;done=false>>]
[junit4] 2> 254993 T1222 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data
[junit4] 2> 254993 T1222 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index;done=false>>]
[junit4] 2> 254994 T1222 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-002/collection1/data/index
[junit4] 2> 254994 T1222 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 255051 T1222 oas.SolrTestCaseJ4.setUp ###Starting doTestIndexAndConfigAliasReplication
[junit4] 2> 255054 T1222 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 255055 T1222 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33553
[junit4] 2> 255056 T1222 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 255056 T1222 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 255056 T1222 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001
[junit4] 2> 255057 T1222 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/'
[junit4] 2> 255078 T1222 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/solr.xml
[junit4] 2> 255086 T1222 oasc.CoreContainer.<init> New CoreContainer 1585863002
[junit4] 2> 255086 T1222 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/]
[junit4] 2> 255087 T1222 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 255087 T1222 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 255087 T1222 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 255087 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 255087 T1222 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 255088 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 255088 T1222 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 255088 T1222 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 255088 T1222 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 255089 T1222 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 255089 T1222 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 255089 T1222 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 255090 T1284 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/'
[junit4] 2> 255103 T1284 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 255118 T1284 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 255119 T1284 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 255120 T1284 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 255123 T1284 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 255123 T1284 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/
[junit4] 2> 255123 T1284 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 255124 T1284 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/
[junit4] 2> 255124 T1284 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 255124 T1284 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data
[junit4] 2> 255124 T1284 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index/
[junit4] 2> 255125 T1284 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 255125 T1284 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/data/index
[junit4] 2> 255125 T1284 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 255128 T1284 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@579fa84a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f2f584),segFN=segments_1,generation=1}
[junit4] 2> 255128 T1284 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 255129 T1284 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 255129 T1284 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 255130 T1284 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 255130 T1284 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 255130 T1284 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 255130 T1284 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 255130 T1284 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 255132 T1284 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 255133 T1284 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 255133 T1284 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 255134 T1284 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=3, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5365425318819433]
[junit4] 2> 255135 T1284 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@579fa84a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f2f584),segFN=segments_1,generation=1}
[junit4] 2> 255135 T1284 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 255136 T1284 oass.SolrIndexSearcher.<init> Opening Searcher@28ffa159[collection1] main
[junit4] 2> 255136 T1284 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf
[junit4] 2> 255136 T1284 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf/}
[junit4] 2> 255136 T1284 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-1A82F1A60F576D8-001/solr-instance-001/collection1/conf
[junit4] 2> 255136 T1284 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 255137 T1284 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 255137 T1284 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 255137 T1284 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 255137 T1284 oash.
[...truncated too long message...]
[junit4] 2> 306313 T1154 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 306313 T1154 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-1A82F1A60F576D8-001/tempDir-001/jetty8/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-1A82F1A60F576D8-001/tempDir-001/jetty8/index;done=false>>]
[junit4] 2> 306313 T1154 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-1A82F1A60F576D8-001/tempDir-001/jetty8/index
[junit4] 2> 306313 T1154 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-1A82F1A60F576D8-001/tempDir-001/jetty8 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-1A82F1A60F576D8-001/tempDir-001/jetty8;done=false>>]
[junit4] 2> 306313 T1154 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-1A82F1A60F576D8-001/tempDir-001/jetty8
[junit4] 2> 306314 T1154 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.<init>(DistributedQueue.java:72)
[junit4] 2> at org.apache.solr.cloud.Overseer.getInQueue(Overseer.java:1225)
[junit4] 2> at org.apache.solr.cloud.Overseer.getInQueue(Overseer.java:1220)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:190)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:444)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:208)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:444)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:208)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:226)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:223)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:223)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:100)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.ensureExists(ZkCmdExecutor.java:94)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.<init>(DistributedQueue.java:70)
[junit4] 2> ... 19 more
[junit4] 2>
[junit4] 2> 306314 T1154 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 8)
[junit4] 2> 306314 T1154 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 306314 T1154 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 306315 T1154 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 306395 T1536 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 306481 T1443 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 306482 T1443 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-1A82F1A60F576D8-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene46), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=zh_HK, timezone=Asia/Macau
[junit4] 2> NOTE: Linux 3.8.0-39-generic amd64/Oracle Corporation 1.8.0_20-ea (64-bit)/cpus=8,threads=1,free=45420128,total=199536640
[junit4] 2> NOTE: All tests run in this JVM: [TestRecoveryHdfs, TestFastWriter, TestFoldingMultitermQuery, XsltUpdateRequestHandlerTest, DistribCursorPagingTest, TestManagedSynonymFilterFactory, TestComponentsName, ConvertedLegacyTest, TestImplicitCoreProperties, TestCloudManagedSchema, PluginInfoTest, SolrRequestParserTest, BlockCacheTest, MigrateRouteKeyTest, TestLRUCache, TestRecovery, TestQuerySenderListener, MergeStrategyTest, TestDocBasedVersionConstraints, OpenExchangeRatesOrgProviderTest, JSONWriterTest, DeleteShardTest, DistributedSuggestComponentTest, FunctionTest, XmlUpdateRequestHandlerTest, TestRestManager, MultiTermTest, StatsComponentTest, TestArbitraryIndexDir, FileUtilsTest, TestCollapseQParserPlugin, UniqFieldsUpdateProcessorFactoryTest, SuggesterWFSTTest, TestSweetSpotSimilarityFactory, CoreContainerCoreInitFailuresTest, ChaosMonkeySafeLeaderTest]
[junit4] Completed on J1 in 87.03s, 1 test, 1 failure <<< FAILURES!
[...truncated 997 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 1 error, 1 failure, 36 ignored (15 assumptions)
Total time: 60 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0_20-ea-b15 -XX:-UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_05) - Build #
10411 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10411/
Java: 32bit/jdk1.8.0_05 -client -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestBackup
Error Message:
Could not remove the following files (in the order of attempts): /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/snapshot.rvbttqs/_0.cfs /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/snapshot.rvbttqs
Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/snapshot.rvbttqs/_0.cfs
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/snapshot.rvbttqs
at __randomizedtesting.SeedInfo.seed([6CE08455B62A10F8:2D6BA4309194E3B7]:0)
at org.apache.lucene.util.TestUtil.rm(TestUtil.java:118)
at org.apache.solr.handler.TestReplicationHandler.doTestBackup(TestReplicationHandler.java:1554)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11211 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/init-core-data-001
[junit4] 2> 930714 T4236 oas.SolrTestCaseJ4.setUp ###Starting doTestReplicateAfterStartup
[junit4] 2> 930721 T4236 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 930732 T4236 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41700
[junit4] 2> 930733 T4236 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 930734 T4236 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 930735 T4236 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001
[junit4] 2> 930735 T4236 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/'
[junit4] 2> 930771 T4236 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/solr.xml
[junit4] 2> 930800 T4236 oasc.CoreContainer.<init> New CoreContainer 4811842
[junit4] 2> 930800 T4236 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/]
[junit4] 2> 930801 T4236 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 930801 T4236 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 930801 T4236 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 930802 T4236 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 930802 T4236 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 930802 T4236 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 930803 T4236 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 930803 T4236 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 930803 T4236 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 930804 T4236 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 930804 T4236 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 930804 T4236 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 930806 T4246 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/'
[junit4] 2> 930848 T4246 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 930876 T4246 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 930877 T4246 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 930881 T4246 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 930890 T4246 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 930891 T4246 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/
[junit4] 2> 930892 T4246 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 930892 T4246 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/
[junit4] 2> 930893 T4246 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 930893 T4246 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data
[junit4] 2> 930894 T4246 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index/
[junit4] 2> 930895 T4246 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 930895 T4246 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index
[junit4] 2> 930899 T4246 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5999135751482717]
[junit4] 2> 930901 T4246 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ea0a33 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f10f5),segFN=segments_1,generation=1}
[junit4] 2> 930901 T4246 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 930903 T4246 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 930903 T4246 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 930903 T4246 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 930904 T4246 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 930904 T4246 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 930905 T4246 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 930905 T4246 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 930908 T4246 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 930909 T4246 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 930910 T4246 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 930910 T4246 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 930911 T4246 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ea0a33 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f10f5),segFN=segments_1,generation=1}
[junit4] 2> 930912 T4246 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 930912 T4246 oass.SolrIndexSearcher.<init> Opening Searcher@aadd2a[collection1] main
[junit4] 2> 930912 T4246 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/conf
[junit4] 2> 930913 T4246 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/conf/}
[junit4] 2> 930913 T4246 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/conf
[junit4] 2> 930914 T4246 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 930914 T4246 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 930915 T4246 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 930915 T4246 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 930916 T4246 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 930916 T4246 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 930916 T4247 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@aadd2a[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 930917 T4236 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 930918 T4236 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 930921 T4236 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 930923 T4236 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:51291
[junit4] 2> 930925 T4236 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 930925 T4236 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 930926 T4236 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002
[junit4] 2> 930927 T4236 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/'
[junit4] 2> 930947 T4236 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/solr.xml
[junit4] 2> 930970 T4236 oasc.CoreContainer.<init> New CoreContainer 11120632
[junit4] 2> 930971 T4236 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/]
[junit4] 2> 930973 T4236 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 930974 T4236 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 930975 T4236 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 930975 T4236 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 930976 T4236 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 930977 T4236 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 930977 T4236 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 930978 T4236 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 930978 T4236 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 930978 T4236 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 930979 T4236 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 930979 T4236 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 930981 T4258 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/'
[junit4] 2> 931013 T4258 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 931038 T4258 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 931039 T4258 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 931043 T4258 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 931051 T4258 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 931052 T4258 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/
[junit4] 2> 931052 T4258 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 931053 T4258 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data/
[junit4] 2> 931061 T4258 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 931062 T4258 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data
[junit4] 2> 931062 T4258 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data/index/
[junit4] 2> 931062 T4258 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 931063 T4258 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data/index
[junit4] 2> 931063 T4258 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5999135751482717]
[junit4] 2> 931064 T4258 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@b80718 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@15fbf5b),segFN=segments_1,generation=1}
[junit4] 2> 931064 T4258 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 931065 T4258 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 931065 T4258 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 931065 T4258 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 931066 T4258 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 931066 T4258 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 931066 T4258 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 931066 T4258 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 931067 T4258 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 931068 T4258 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 931068 T4258 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 931069 T4258 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 931069 T4258 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@b80718 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@15fbf5b),segFN=segments_1,generation=1}
[junit4] 2> 931069 T4258 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 931070 T4258 oass.SolrIndexSearcher.<init> Opening Searcher@1cf65fb[collection1] main
[junit4] 2> 931070 T4258 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/conf
[junit4] 2> 931070 T4258 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/conf/}
[junit4] 2> 931070 T4258 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/conf
[junit4] 2> 931071 T4258 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 931071 T4258 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 931071 T4258 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 931073 T4258 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4] 2> 931073 T4258 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 931073 T4259 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1cf65fb[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 931073 T4236 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 931074 T4236 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 931095 T4236 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=11120632
[junit4] 2> 931097 T4236 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@176fbcb
[junit4] 2> 931098 T4236 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 931099 T4236 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 931099 T4236 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 931100 T4236 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 931101 T4236 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 931102 T4236 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 931102 T4236 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data/index;done=false>>]
[junit4] 2> 931103 T4236 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data/index
[junit4] 2> 931104 T4236 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data;done=false>>]
[junit4] 2> 931105 T4236 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data
[junit4] 2> 931106 T4236 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> ASYNC NEW_CORE C16133 name=collection1 org.apache.solr.core.SolrCore@2e7794
[junit4] 2> 931161 T4244 C16133 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
[junit4] 2> 931162 T4244 C16133 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 2
[junit4] 2> 931165 T4245 C16133 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 931167 T4245 C16133 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ea0a33 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f10f5),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ea0a33 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f10f5),segFN=segments_2,generation=2}
[junit4] 2> 931168 T4245 C16133 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 931170 T4245 C16133 oass.SolrIndexSearcher.<init> Opening Searcher@125fdec[collection1] main
[junit4] 2> 931171 T4245 C16133 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 931171 T4247 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@125fdec[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 931172 T4245 C16133 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 7
[junit4] 2> 931194 T4236 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=4811842
[junit4] 2> 931196 T4236 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@2e7794
[junit4] 2> 931197 T4236 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
[junit4] 2> 931199 T4236 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 931200 T4236 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 931201 T4236 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 931203 T4236 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 931204 T4236 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 931205 T4236 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data;done=false>>]
[junit4] 2> 931206 T4236 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data
[junit4] 2> 931207 T4236 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index;done=false>>]
[junit4] 2> 931208 T4236 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index
[junit4] 2> 931210 T4236 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 931264 T4236 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 931270 T4236 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60125
[junit4] 2> 931271 T4236 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 931272 T4236 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 931272 T4236 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001
[junit4] 2> 931273 T4236 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/'
[junit4] 2> 931307 T4236 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/solr.xml
[junit4] 2> 931356 T4236 oasc.CoreContainer.<init> New CoreContainer 17960864
[junit4] 2> 931357 T4236 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/]
[junit4] 2> 931358 T4236 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 931358 T4236 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 931359 T4236 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 931359 T4236 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 931360 T4236 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 931360 T4236 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 931361 T4236 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 931361 T4236 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 931365 T4236 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 931366 T4236 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 931367 T4236 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 931367 T4236 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 931369 T4271 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/'
[junit4] 2> 931402 T4271 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 931423 T4271 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 931424 T4271 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 931427 T4271 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 931433 T4271 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 931434 T4271 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/
[junit4] 2> 931434 T4271 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 931434 T4271 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/
[junit4] 2> 931435 T4271 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 931435 T4271 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data
[junit4] 2> 931436 T4271 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index/
[junit4] 2> 931436 T4271 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 931437 T4271 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index
[junit4] 2> 931438 T4271 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5999135751482717]
[junit4] 2> 931438 T4271 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1b3bbe6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@9beb3e),segFN=segments_1,generation=1}
[junit4] 2> 931439 T4271 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 931440 T4271 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 931440 T4271 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 931441 T4271 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 931441 T4271 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 931441 T4271 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 931441 T4271 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 931442 T4271 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 931443 T4271 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 931443 T4271 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 931444 T4271 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 931444 T4271 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 931444 T4271 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1b3bbe6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@9beb3e),segFN=segments_1,generation=1}
[junit4] 2> 931445 T4271 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 931445 T4271 oass.SolrIndexSearcher.<init> Opening Searcher@80e7a4[collection1] main
[junit4] 2> 931445 T4271 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/conf
[junit4] 2> 931445 T4271 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/conf/}
[junit4] 2> 931446 T4271 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/conf
[junit4] 2> 931446 T4271 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 931446 T4271 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 931446 T4271 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 931447 T4271 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml
[junit4] 2> 931447 T4271 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 931447 T4271 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 931447 T4272 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@80e7a4[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 931448 T4236 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 931448 T4236 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> ASYNC NEW_CORE C16134 name=collection1 org.apache.solr.core.SolrCore@1dce2a9
[junit4] 2> 931451 T4267 C16134 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 0
[junit4] 2> 931454 T4268 C16134 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 1
[junit4] 2> 931456 T4270 C16134 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4] 2> 931458 T4269 C16134 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
[junit4] 2> 931460 T4267 C16134 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
[junit4] 2> ASYNC NEW_CORE C16135 name=collection1 org.apache.solr.core.SolrCore@1dce2a9
[junit4] 2> 931467 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 0
[junit4] 2> 931470 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
[junit4] 2> 931472 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 0
[junit4] 2> 931474 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 0
[junit4] 2> 931476 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 0
[junit4] 2> 931479 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 0
[junit4] 2> 931482 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 1
[junit4] 2> 931484 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 0
[junit4] 2> 931486 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
[junit4] 2> 931489 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 0
[junit4] 2> 931492 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 0
[junit4] 2> 931494 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
[junit4] 2> 931497 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 0
[junit4] 2> 931500 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 1
[junit4] 2> 931502 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
[junit4] 2> 931504 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
[junit4] 2> 931507 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
[junit4] 2> 931510 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
[junit4] 2> 931513 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 0
[junit4] 2> 931515 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 0
[junit4] 2> 931518 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
[junit4] 2> 931521 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 0
[junit4] 2> 931524 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 1
[junit4] 2> 931526 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 0
[junit4] 2> 931529 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 0
[junit4] 2> 931531 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 0
[junit4] 2> 931533 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 0
[junit4] 2> 931535 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 0
[junit4] 2> 931537 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 0
[junit4] 2> 931539 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 0
[junit4] 2> 931541 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
[junit4] 2> 931543 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 0
[junit4] 2> 931545 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
[junit4] 2> 931547 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 0
[junit4] 2> 931550 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 1
[junit4] 2> 931552 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 0
[junit4] 2> 931555 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 0
[junit4] 2> 931557 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 0
[junit4] 2> 931560 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 0
[junit4] 2> 931563 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
[junit4] 2> 931565 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 0
[junit4] 2> 931568 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 0
[junit4] 2> 931571 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 0
[junit4] 2> 931573 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 0
[junit4] 2> 931576 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 0
[junit4] 2> 931579 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 0
[junit4] 2> 931581 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 0
[junit4] 2> 931584 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 0
[junit4] 2> 931586 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
[junit4] 2> 931589 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 0
[junit4] 2> 931591 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 0
[junit4] 2> 931594 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 0
[junit4] 2> 931597 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 0
[junit4] 2> 931600 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 0
[junit4] 2> 931603 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 1
[junit4] 2> 931605 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 0
[junit4] 2> 931608 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 0
[junit4] 2> 931611 T4270 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 0
[junit4] 2> 931613 T4269 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 0
[junit4] 2> 931616 T4267 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 0
[junit4] 2> 931619 T4268 C16135 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 0
[junit4] 2> ASYNC NEW_CORE C16136 name=collection1 org.apache.solr.core.SolrCore@1dce2a9
[junit4] 2> 931626 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[66]} 0 0
[junit4] 2> 931628 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[67]} 0 0
[junit4] 2> 931631 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[68]} 0 0
[junit4] 2> 931634 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[69]} 0 0
[junit4] 2> 931637 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[70]} 0 1
[junit4] 2> 931639 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[71]} 0 0
[junit4] 2> 931642 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[72]} 0 0
[junit4] 2> 931645 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[73]} 0 0
[junit4] 2> 931647 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[74]} 0 0
[junit4] 2> 931650 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[75]} 0 0
[junit4] 2> 931653 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[76]} 0 1
[junit4] 2> 931655 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[77]} 0 0
[junit4] 2> 931658 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[78]} 0 0
[junit4] 2> 931661 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[79]} 0 1
[junit4] 2> 931664 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[80]} 0 1
[junit4] 2> 931666 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[81]} 0 0
[junit4] 2> 931669 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[82]} 0 0
[junit4] 2> 931672 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[83]} 0 0
[junit4] 2> 931674 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[84]} 0 0
[junit4] 2> 931677 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[85]} 0 0
[junit4] 2> 931680 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[86]} 0 0
[junit4] 2> 931683 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[87]} 0 0
[junit4] 2> 931686 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[88]} 0 0
[junit4] 2> 931688 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[89]} 0 0
[junit4] 2> 931691 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[90]} 0 0
[junit4] 2> 931694 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[91]} 0 0
[junit4] 2> 931697 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[92]} 0 0
[junit4] 2> 931700 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[93]} 0 1
[junit4] 2> 931702 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[94]} 0 0
[junit4] 2> 931705 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[95]} 0 0
[junit4] 2> 931708 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[96]} 0 0
[junit4] 2> 931710 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[97]} 0 0
[junit4] 2> 931713 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[98]} 0 0
[junit4] 2> 931716 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[99]} 0 0
[junit4] 2> 931719 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[100]} 0 1
[junit4] 2> 931722 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[101]} 0 1
[junit4] 2> 931724 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[102]} 0 0
[junit4] 2> 931727 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[103]} 0 0
[junit4] 2> 931730 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[104]} 0 0
[junit4] 2> 931732 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[105]} 0 0
[junit4] 2> 931735 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[106]} 0 0
[junit4] 2> 931738 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[107]} 0 0
[junit4] 2> 931741 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[108]} 0 1
[junit4] 2> 931743 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[109]} 0 0
[junit4] 2> 931746 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[110]} 0 0
[junit4] 2> 931749 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[111]} 0 0
[junit4] 2> 931752 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[112]} 0 0
[junit4] 2> 931754 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[113]} 0 0
[junit4] 2> 931757 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[114]} 0 0
[junit4] 2> 931760 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[115]} 0 0
[junit4] 2> 931763 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[116]} 0 1
[junit4] 2> 931765 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[117]} 0 0
[junit4] 2> 931768 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[118]} 0 0
[junit4] 2> 931771 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[119]} 0 0
[junit4] 2> 931773 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[120]} 0 0
[junit4] 2> 931776 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[121]} 0 0
[junit4] 2> 931779 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[122]} 0 1
[junit4] 2> 931781 T4269 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[123]} 0 0
[junit4] 2> 931784 T4268 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[124]} 0 0
[junit4] 2> 931787 T4270 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[125]} 0 0
[junit4] 2> 931790 T4267 C16136 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[126]} 0 1
[junit4] 2> ASYNC NEW_CORE C16137 name=collection1 org.apache.solr.core.SolrCore@1dce2a9
[junit4] 2> 931796 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[127]} 0 0
[junit4] 2> 931799 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[128]} 0 0
[junit4] 2> 931802 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[129]} 0 0
[junit4] 2> 931804 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[130]} 0 0
[junit4] 2> 931807 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[131]} 0 0
[junit4] 2> 931810 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[132]} 0 0
[junit4] 2> 931813 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[133]} 0 0
[junit4] 2> 931815 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[134]} 0 0
[junit4] 2> 931818 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[135]} 0 0
[junit4] 2> 931821 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[136]} 0 0
[junit4] 2> 931824 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[137]} 0 0
[junit4] 2> 931826 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[138]} 0 0
[junit4] 2> 931829 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[139]} 0 0
[junit4] 2> 931832 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[140]} 0 0
[junit4] 2> 931835 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[141]} 0 1
[junit4] 2> 931837 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[142]} 0 0
[junit4] 2> 931840 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[143]} 0 0
[junit4] 2> 931842 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[144]} 0 0
[junit4] 2> 931845 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[145]} 0 0
[junit4] 2> 931848 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[146]} 0 0
[junit4] 2> 931851 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[147]} 0 1
[junit4] 2> 931854 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[148]} 0 1
[junit4] 2> 931856 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[149]} 0 0
[junit4] 2> 931859 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[150]} 0 0
[junit4] 2> 931862 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[151]} 0 0
[junit4] 2> 931865 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[152]} 0 0
[junit4] 2> 931868 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[153]} 0 1
[junit4] 2> 931870 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[154]} 0 0
[junit4] 2> 931873 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[155]} 0 0
[junit4] 2> 931876 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[156]} 0 0
[junit4] 2> 931878 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[157]} 0 0
[junit4] 2> 931881 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[158]} 0 0
[junit4] 2> 931883 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[159]} 0 0
[junit4] 2> 931886 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[160]} 0 0
[junit4] 2> 931889 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[161]} 0 0
[junit4] 2> 931892 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[162]} 0 1
[junit4] 2> 931894 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[163]} 0 0
[junit4] 2> 931897 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[164]} 0 0
[junit4] 2> 931900 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[165]} 0 1
[junit4] 2> 931902 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[166]} 0 0
[junit4] 2> 931905 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[167]} 0 0
[junit4] 2> 931908 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[168]} 0 1
[junit4] 2> 931910 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[169]} 0 0
[junit4] 2> 931913 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[170]} 0 0
[junit4] 2> 931916 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[171]} 0 1
[junit4] 2> 931918 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[172]} 0 0
[junit4] 2> 931921 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[173]} 0 0
[junit4] 2> 931924 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[174]} 0 0
[junit4] 2> 931927 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[175]} 0 1
[junit4] 2> 931929 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[176]} 0 0
[junit4] 2> 931932 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[177]} 0 0
[junit4] 2> 931935 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[178]} 0 0
[junit4] 2> 931938 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[179]} 0 1
[junit4] 2> 931940 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[180]} 0 0
[junit4] 2> 931943 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[181]} 0 0
[junit4] 2> 931946 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[182]} 0 0
[junit4] 2> 931948 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[183]} 0 0
[junit4] 2> 931951 T4268 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[184]} 0 0
[junit4] 2> 931954 T4270 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[185]} 0 1
[junit4] 2> 931956 T4267 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[186]} 0 0
[junit4] 2> 931959 T4269 C16137 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[187]} 0 0
[junit4] 2> ASYNC NEW_CORE C16138 name=collection1 org.apache.solr.core.SolrCore@1dce2a9
[junit4] 2> 931965 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[188]} 0 0
[junit4] 2> 931968 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[189]} 0 0
[junit4] 2> 931970 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[190]} 0 0
[junit4] 2> 931973 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[191]} 0 0
[junit4] 2> 931976 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[192]} 0 0
[junit4] 2> 931979 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[193]} 0 1
[junit4] 2> 931981 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[194]} 0 0
[junit4] 2> 931984 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[195]} 0 0
[junit4] 2> 931987 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[196]} 0 1
[junit4] 2> 931989 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[197]} 0 0
[junit4] 2> 931992 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[198]} 0 0
[junit4] 2> 931995 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[199]} 0 1
[junit4] 2> 931997 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[200]} 0 0
[junit4] 2> 932000 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[201]} 0 0
[junit4] 2> 932003 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[202]} 0 0
[junit4] 2> 932006 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[203]} 0 1
[junit4] 2> 932008 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[204]} 0 0
[junit4] 2> 932011 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[205]} 0 0
[junit4] 2> 932014 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[206]} 0 0
[junit4] 2> 932017 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[207]} 0 1
[junit4] 2> 932020 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[208]} 0 0
[junit4] 2> 932023 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[209]} 0 0
[junit4] 2> 932026 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[210]} 0 0
[junit4] 2> 932028 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[211]} 0 0
[junit4] 2> 932031 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[212]} 0 0
[junit4] 2> 932034 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[213]} 0 1
[junit4] 2> 932036 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[214]} 0 0
[junit4] 2> 932039 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[215]} 0 0
[junit4] 2> 932042 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[216]} 0 0
[junit4] 2> 932045 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[217]} 0 0
[junit4] 2> 932047 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[218]} 0 0
[junit4] 2> 932050 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[219]} 0 0
[junit4] 2> 932053 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[220]} 0 0
[junit4] 2> 932056 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[221]} 0 1
[junit4] 2> 932058 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[222]} 0 0
[junit4] 2> 932061 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[223]} 0 0
[junit4] 2> 932064 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[224]} 0 0
[junit4] 2> 932067 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[225]} 0 1
[junit4] 2> 932069 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[226]} 0 0
[junit4] 2> 932072 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[227]} 0 0
[junit4] 2> 932075 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[228]} 0 1
[junit4] 2> 932077 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[229]} 0 0
[junit4] 2> 932080 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[230]} 0 0
[junit4] 2> 932083 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[231]} 0 0
[junit4] 2> 932085 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[232]} 0 0
[junit4] 2> 932088 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[233]} 0 0
[junit4] 2> 932090 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[234]} 0 0
[junit4] 2> 932093 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[235]} 0 0
[junit4] 2> 932095 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[236]} 0 0
[junit4] 2> 932098 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[237]} 0 0
[junit4] 2> 932101 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[238]} 0 0
[junit4] 2> 932104 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[239]} 0 1
[junit4] 2> 932106 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[240]} 0 0
[junit4] 2> 932109 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[241]} 0 0
[junit4] 2> 932111 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[242]} 0 0
[junit4] 2> 932114 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[243]} 0 0
[junit4] 2> 932117 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[244]} 0 0
[junit4] 2> 932120 T4269 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[245]} 0 1
[junit4] 2> 932122 T4270 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[246]} 0 0
[junit4] 2> 932125 T4268 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[247]} 0 0
[junit4] 2> 932127 T4267 C16138 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[248]} 0 0
[junit4] 2> ASYNC NEW_CORE C16139 name=collection1 org.apache.solr.core.SolrCore@1dce2a9
[junit4] 2> 932134 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[249]} 0 1
[junit4] 2> 932136 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[250]} 0 0
[junit4] 2> 932139 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[251]} 0 0
[junit4] 2> 932142 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[252]} 0 0
[junit4] 2> 932145 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[253]} 0 1
[junit4] 2> 932147 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[254]} 0 0
[junit4] 2> 932150 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[255]} 0 0
[junit4] 2> 932153 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[256]} 0 0
[junit4] 2> 932155 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[257]} 0 0
[junit4] 2> 932158 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[258]} 0 0
[junit4] 2> 932161 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[259]} 0 0
[junit4] 2> 932163 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[260]} 0 0
[junit4] 2> 932166 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[261]} 0 0
[junit4] 2> 932169 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[262]} 0 0
[junit4] 2> 932171 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[263]} 0 0
[junit4] 2> 932174 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[264]} 0 0
[junit4] 2> 932177 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[265]} 0 0
[junit4] 2> 932179 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[266]} 0 0
[junit4] 2> 932182 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[267]} 0 0
[junit4] 2> 932185 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[268]} 0 0
[junit4] 2> 932188 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[269]} 0 0
[junit4] 2> 932190 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[270]} 0 0
[junit4] 2> 932193 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[271]} 0 0
[junit4] 2> 932196 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[272]} 0 0
[junit4] 2> 932198 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[273]} 0 0
[junit4] 2> 932201 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[274]} 0 0
[junit4] 2> 932204 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[275]} 0 0
[junit4] 2> 932207 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[276]} 0 0
[junit4] 2> 932210 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[277]} 0 0
[junit4] 2> 932212 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[278]} 0 0
[junit4] 2> 932215 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[279]} 0 0
[junit4] 2> 932218 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[280]} 0 0
[junit4] 2> 932221 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[281]} 0 1
[junit4] 2> 932223 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[282]} 0 0
[junit4] 2> 932226 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[283]} 0 0
[junit4] 2> 932229 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[284]} 0 0
[junit4] 2> 932231 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[285]} 0 0
[junit4] 2> 932234 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[286]} 0 0
[junit4] 2> 932238 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[287]} 0 1
[junit4] 2> 932241 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[288]} 0 1
[junit4] 2> 932243 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[289]} 0 0
[junit4] 2> 932246 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[290]} 0 0
[junit4] 2> 932249 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[291]} 0 0
[junit4] 2> 932252 T4267 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[292]} 0 1
[junit4] 2> 932254 T4269 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[293]} 0 0
[junit4] 2> 932257 T4270 C16139 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[294]} 0 0
[junit4] 2> 932260 T4268 C16139 oasup.LogUpdateProcessor.finish [collection1] we
[...truncated too long message...]
eContainer.shutdown Shutting down CoreContainer instance=1333787
[junit4] 2> 966687 T4236 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@12dfebc
[junit4] 2> 966688 T4236 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=2,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=6,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 966688 T4236 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 966689 T4236 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 966690 T4236 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 966691 T4236 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 966692 T4236 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 966692 T4236 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data;done=false>>]
[junit4] 2> 966693 T4236 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data
[junit4] 2> 966694 T4236 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index;done=false>>]
[junit4] 2> 966695 T4236 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-001/collection1/data/index
[junit4] 2> 966696 T4236 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 966769 T4236 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=17411598
[junit4] 2> 966770 T4236 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@a80f06
[junit4] 2> 966770 T4236 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 966771 T4236 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 966772 T4236 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 966772 T4236 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 966773 T4236 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 966774 T4236 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 966774 T4236 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data/index;done=false>>]
[junit4] 2> 966775 T4236 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data/index
[junit4] 2> 966776 T4236 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data;done=false>>]
[junit4] 2> 966777 T4236 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001/solr-instance-002/collection1/data
[junit4] 2> 966777 T4236 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 966834 T4236 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-6CE08455B62A10F8-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=uk_UA, timezone=Antarctica/Mawson
[junit4] 2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.8.0_05 (32-bit)/cpus=8,threads=1,free=440339536,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [DistributedTermsComponentTest, TestSchemaResource, TestNonNRTOpen, TestSolrXml, HdfsRecoveryZkTest, TestRealTimeGet, TestAnalyzeInfixSuggestions, UnloadDistributedZkTest, TestSort, BadCopyFieldTest, SynonymTokenizerTest, DirectUpdateHandlerOptimizeTest, TestSuggestSpellingConverter, SpellingQueryConverterTest, ClusterStateUpdateTest, URLClassifyProcessorTest, TestShardHandlerFactory, TestLMJelinekMercerSimilarityFactory, TestDocSet, HdfsDirectoryTest, SoftAutoCommitTest, CursorMarkTest, AsyncMigrateRouteKeyTest, MoreLikeThisHandlerTest, OverseerCollectionProcessorTest, TestMergePolicyConfig, CursorPagingTest, TestCopyFieldCollectionResource, HdfsChaosMonkeySafeLeaderTest, TestJmxMonitoredMap, TestConfig, CoreAdminHandlerTest, TestConfigSets, FieldMutatingUpdateProcessorTest, PolyFieldTest, JsonLoaderTest, UpdateParamsTest, TestInitQParser, DistributedDebugComponentTest, QueryEqualityTest, TestSearcherReuse, TestTrie, ZkCLITest, TestExpandComponent, TestLFUCache, TestDefaultSimilarityFactory, DistributedSpellCheckComponentTest, PrimitiveFieldTypeTest, HdfsWriteToMultipleCollectionsTest, TermVectorComponentTest, AnalysisErrorHandlingTest, TestComplexPhraseQParserPlugin, CSVRequestHandlerTest, TestRandomDVFaceting, ClusterStateTest, TestStressUserVersions, CachingDirectoryFactoryTest, TestFieldCollectionResource, HdfsCollectionsAPIDistributedZkTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestSolrXmlPersistence, TestQueryUtils, SimpleFacetsTest, StatelessScriptUpdateProcessorFactoryTest, BadComponentTest, SchemaVersionSpecificBehaviorTest, RangeFacetTest, TestSolrIndexConfig, LukeRequestHandlerTest, DocumentBuilderTest, MBeansHandlerTest, TestDefaultSearchFieldResource, TestSystemIdResolver, DistributedQueryComponentOptimizationTest, QueryElevationComponentTest, OverseerRolesTest, SuggesterTest, TestManagedSchemaFieldResource, IndexSchemaTest, PreAnalyzedUpdateProcessorTest, CircularListTest, EchoParamsTest, PeerSyncTest, TestGroupingSearch, TermsComponentTest, TestNRTOpen, TestCoreContainer, ReturnFieldsTest, TestHighlightDedupGrouping, CustomCollectionTest, BinaryUpdateRequestHandlerTest, SampleTest, BJQParserTest, TestLuceneMatchVersion, TestFastLRUCache, TestPostingsSolrHighlighter, TimeZoneUtilsTest, RemoteQueryErrorTest, TestNonDefinedSimilarityFactory, BasicDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, ShardRoutingTest, RecoveryZkTest, TestReplicationHandler]
[junit4] Completed on J0 in 36.19s, 14 tests, 1 error <<< FAILURES!
[...truncated 595 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 1 error, 36 ignored (15 assumptions)
Total time: 67 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0_05 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20-ea-b15) -
Build # 10410 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10410/
Java: 32bit/jdk1.8.0_20-ea-b15 -server -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.handler.TestReplicationHandler.doTestBackup
Error Message:
Could not remove the following files (in the order of attempts): /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/snapshot.xlnvkbtwbbqvtdlfmnzl/_0.nvd /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/snapshot.xlnvkbtwbbqvtdlfmnzl/_0_Lucene41VarGapFixedInterval_0.tib /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/snapshot.xlnvkbtwbbqvtdlfmnzl
Stack Trace:
java.io.IOException: Could not remove the following files (in the order of attempts):
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/snapshot.xlnvkbtwbbqvtdlfmnzl/_0.nvd
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/snapshot.xlnvkbtwbbqvtdlfmnzl/_0_Lucene41VarGapFixedInterval_0.tib
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/snapshot.xlnvkbtwbbqvtdlfmnzl
at __randomizedtesting.SeedInfo.seed([4C8AB86F544D2CD0:D01980A73F3DF9F]:0)
at org.apache.lucene.util.TestUtil.rm(TestUtil.java:118)
at org.apache.solr.handler.TestReplicationHandler.doTestBackup(TestReplicationHandler.java:1554)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11171 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/init-core-data-001
[junit4] 2> 1195800 T4474 oas.SolrTestCaseJ4.setUp ###Starting doTestRepeater
[junit4] 2> 1195804 T4474 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1195809 T4474 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40222
[junit4] 2> 1195810 T4474 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1195810 T4474 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1195811 T4474 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001
[junit4] 2> 1195811 T4474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/'
[junit4] 2> 1195825 T4474 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/solr.xml
[junit4] 2> 1195832 T4474 oasc.CoreContainer.<init> New CoreContainer 4585556
[junit4] 2> 1195833 T4474 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/]
[junit4] 2> 1195833 T4474 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1195834 T4474 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1195834 T4474 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1195834 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1195834 T4474 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1195835 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1195835 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1195835 T4474 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1195836 T4474 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1195836 T4474 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1195836 T4474 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1195837 T4474 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1195839 T4484 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/'
[junit4] 2> 1195852 T4484 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1195858 T4484 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1195858 T4484 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1195860 T4484 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1195865 T4484 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1195866 T4484 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/
[junit4] 2> 1195866 T4484 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1195866 T4484 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/
[junit4] 2> 1195866 T4484 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 1195867 T4484 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data
[junit4] 2> 1195867 T4484 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/index/
[junit4] 2> 1195867 T4484 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1195867 T4484 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/index
[junit4] 2> 1195868 T4484 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7361801935530407]
[junit4] 2> 1195868 T4484 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ea4766 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13fbbff),segFN=segments_1,generation=1}
[junit4] 2> 1195868 T4484 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1195869 T4484 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1195869 T4484 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1195869 T4484 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1195870 T4484 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 1195870 T4484 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 1195870 T4484 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 1195870 T4484 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1195871 T4484 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1195872 T4484 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1195872 T4484 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1195872 T4484 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=18.9091796875, floorSegmentMB=0.35546875, forceMergeDeletesPctAllowed=26.673754720087402, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6197256481383131
[junit4] 2> 1195873 T4484 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ea4766 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13fbbff),segFN=segments_1,generation=1}
[junit4] 2> 1195873 T4484 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1195873 T4484 oass.SolrIndexSearcher.<init> Opening Searcher@8fd86f[collection1] main
[junit4] 2> 1195873 T4484 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/conf
[junit4] 2> 1195874 T4484 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/conf/}
[junit4] 2> 1195874 T4484 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/conf
[junit4] 2> 1195874 T4484 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 1195874 T4484 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1195874 T4484 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1195875 T4484 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 1195875 T4484 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1195875 T4484 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1195875 T4485 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@8fd86f[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 1195876 T4474 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1195876 T4474 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1195879 T4474 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1195880 T4474 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43150
[junit4] 2> 1195881 T4474 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1195881 T4474 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1195882 T4474 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002
[junit4] 2> 1195882 T4474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/'
[junit4] 2> 1195890 T4474 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/solr.xml
[junit4] 2> 1195896 T4474 oasc.CoreContainer.<init> New CoreContainer 3527044
[junit4] 2> 1195897 T4474 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/]
[junit4] 2> 1195897 T4474 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1195897 T4474 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1195898 T4474 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1195898 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1195898 T4474 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1195898 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1195899 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1195899 T4474 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1195899 T4474 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1195900 T4474 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1195900 T4474 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1195900 T4474 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1195902 T4496 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/'
[junit4] 2> 1195915 T4496 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1195924 T4496 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1195924 T4496 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1195926 T4496 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1195928 T4496 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1195928 T4496 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/
[junit4] 2> 1195928 T4496 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1195929 T4496 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/
[junit4] 2> 1195929 T4496 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 1195929 T4496 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data
[junit4] 2> 1195929 T4496 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index/
[junit4] 2> 1195930 T4496 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1195930 T4496 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index
[junit4] 2> 1195931 T4496 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7361801935530407]
[junit4] 2> 1195931 T4496 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@f27ede lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1cdf9f3),segFN=segments_1,generation=1}
[junit4] 2> 1195931 T4496 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1195932 T4496 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1195932 T4496 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1195932 T4496 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 1195932 T4496 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 1195932 T4496 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 1195933 T4496 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1195933 T4496 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1195934 T4496 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1195934 T4496 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1195934 T4496 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1195935 T4496 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=18.9091796875, floorSegmentMB=0.35546875, forceMergeDeletesPctAllowed=26.673754720087402, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6197256481383131
[junit4] 2> 1195935 T4496 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@f27ede lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1cdf9f3),segFN=segments_1,generation=1}
[junit4] 2> 1195935 T4496 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1195935 T4496 oass.SolrIndexSearcher.<init> Opening Searcher@1d01ef8[collection1] main
[junit4] 2> 1195936 T4496 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/conf
[junit4] 2> 1195936 T4496 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/conf/}
[junit4] 2> 1195936 T4496 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/conf
[junit4] 2> 1195936 T4496 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 1195937 T4496 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1195937 T4496 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1195937 T4496 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4] 2> 1195938 T4497 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d01ef8[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 1195938 T4496 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1195938 T4474 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1195938 T4474 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1195960 T4474 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=3527044
[junit4] 2> 1195961 T4474 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@194bc12
[junit4] 2> 1195961 T4474 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 1195962 T4474 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1195962 T4474 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1195963 T4474 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1195963 T4474 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1195964 T4474 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1195964 T4474 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data;done=false>>]
[junit4] 2> 1195965 T4474 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data
[junit4] 2> 1195965 T4474 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index;done=false>>]
[junit4] 2> 1195966 T4474 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index
[junit4] 2> 1195966 T4474 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 1196019 T4474 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1196021 T4474 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53296
[junit4] 2> 1196021 T4474 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1196022 T4474 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1196022 T4474 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002
[junit4] 2> 1196022 T4474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/'
[junit4] 2> 1196030 T4474 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/solr.xml
[junit4] 2> 1196036 T4474 oasc.CoreContainer.<init> New CoreContainer 16707739
[junit4] 2> 1196037 T4474 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/]
[junit4] 2> 1196037 T4474 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1196037 T4474 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1196038 T4474 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1196038 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1196038 T4474 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1196038 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1196039 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1196039 T4474 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1196039 T4474 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1196040 T4474 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1196040 T4474 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1196040 T4474 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1196042 T4509 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/'
[junit4] 2> 1196060 T4509 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1196066 T4509 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1196067 T4509 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1196069 T4509 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1196071 T4509 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1196071 T4509 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/
[junit4] 2> 1196071 T4509 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1196072 T4509 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/
[junit4] 2> 1196072 T4509 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 1196072 T4509 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data
[junit4] 2> 1196072 T4509 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index/
[junit4] 2> 1196073 T4509 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1196073 T4509 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index
[junit4] 2> 1196073 T4509 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7361801935530407]
[junit4] 2> 1196074 T4509 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@13a68a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@aeb613),segFN=segments_1,generation=1}
[junit4] 2> 1196074 T4509 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1196075 T4509 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1196075 T4509 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1196075 T4509 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 1196075 T4509 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 1196075 T4509 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 1196075 T4509 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1196076 T4509 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1196077 T4509 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1196077 T4509 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1196077 T4509 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1196078 T4509 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=18.9091796875, floorSegmentMB=0.35546875, forceMergeDeletesPctAllowed=26.673754720087402, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6197256481383131
[junit4] 2> 1196078 T4509 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@13a68a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@aeb613),segFN=segments_1,generation=1}
[junit4] 2> 1196078 T4509 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1196078 T4509 oass.SolrIndexSearcher.<init> Opening Searcher@17cfc4d[collection1] main
[junit4] 2> 1196079 T4509 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/conf
[junit4] 2> 1196079 T4509 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/conf/}
[junit4] 2> 1196079 T4509 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/conf
[junit4] 2> 1196079 T4509 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 1196079 T4509 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1196080 T4509 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1196080 T4509 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1196080 T4510 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@17cfc4d[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 1196080 T4509 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1196081 T4474 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1196081 T4474 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1196084 T4474 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1196086 T4474 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:41739
[junit4] 2> 1196087 T4474 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1196087 T4474 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1196088 T4474 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003
[junit4] 2> 1196088 T4474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/'
[junit4] 2> 1196097 T4474 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/solr.xml
[junit4] 2> 1196106 T4474 oasc.CoreContainer.<init> New CoreContainer 24131346
[junit4] 2> 1196107 T4474 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/]
[junit4] 2> 1196107 T4474 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1196107 T4474 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1196108 T4474 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1196108 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1196108 T4474 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1196108 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1196109 T4474 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1196109 T4474 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1196109 T4474 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1196110 T4474 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1196110 T4474 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1196110 T4474 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1196111 T4521 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/'
[junit4] 2> 1196125 T4521 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1196131 T4521 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1196131 T4521 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1196133 T4521 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1196135 T4521 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1196135 T4521 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/
[junit4] 2> 1196135 T4521 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1196135 T4521 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/data/
[junit4] 2> 1196136 T4521 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 1196136 T4521 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/data
[junit4] 2> 1196136 T4521 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/data/index/
[junit4] 2> 1196136 T4521 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1196137 T4521 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/data/index
[junit4] 2> 1196138 T4521 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7361801935530407]
[junit4] 2> 1196138 T4521 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@ae7cf7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@dc3e2b),segFN=segments_1,generation=1}
[junit4] 2> 1196138 T4521 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1196139 T4521 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1196139 T4521 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1196139 T4521 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 1196139 T4521 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 1196140 T4521 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 1196140 T4521 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1196140 T4521 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1196141 T4521 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1196141 T4521 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1196142 T4521 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1196142 T4521 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=18.9091796875, floorSegmentMB=0.35546875, forceMergeDeletesPctAllowed=26.673754720087402, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6197256481383131
[junit4] 2> 1196142 T4521 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@ae7cf7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@dc3e2b),segFN=segments_1,generation=1}
[junit4] 2> 1196142 T4521 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1196142 T4521 oass.SolrIndexSearcher.<init> Opening Searcher@1671dad[collection1] main
[junit4] 2> 1196143 T4521 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/conf
[junit4] 2> 1196143 T4521 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/conf/}
[junit4] 2> 1196143 T4521 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/conf
[junit4] 2> 1196143 T4521 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 1196144 T4521 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1196144 T4521 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1196144 T4521 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 1196144 T4521 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 1196144 T4521 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml
[junit4] 2> 1196144 T4521 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1196145 T4521 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1196145 T4522 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1671dad[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 1196145 T4474 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1196145 T4474 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> ASYNC NEW_CORE C2955 name=collection1 org.apache.solr.core.SolrCore@30bd38
[junit4] 2> 1196147 T4480 C2955 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 0
[junit4] 2> 1196149 T4481 C2955 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
[junit4] 2> 1196151 T4482 C2955 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4] 2> 1196153 T4483 C2955 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1196154 T4483 C2955 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ea4766 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13fbbff),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1ea4766 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13fbbff),segFN=segments_2,generation=2}
[junit4] 2> 1196154 T4483 C2955 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 1196206 T4483 C2955 oass.SolrIndexSearcher.<init> Opening Searcher@129e61d[collection1] main
[junit4] 2> 1196206 T4483 C2955 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 1196206 T4485 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@129e61d[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C3))}
[junit4] 2> 1196207 T4483 C2955 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 54
[junit4] 2> 1196225 T4524 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 1196225 T4524 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 1196226 T4482 C2955 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1196227 T4524 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4] 2> 1196227 T4524 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4] 2> 1196227 T4524 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4] 2> 1196230 T4483 C2955 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=2
[junit4] 2> 1196230 T4524 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 10
[junit4] 2> 1196230 T4524 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/data/index.20140528223409627
[junit4] 2> 1196231 T4524 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4] 2> 1196231 T4524 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 1196231 T4524 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 1196231 T4524 oash.SnapPuller.fetchLatestIndex Starting download to MockDirectoryWrapper(RAMDirectory@1519431 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1795aaf) fullCopy=false
[junit4] 2> 1196233 T4480 C2955 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene41VarGapFixedInterval_0.tib&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196236 T4481 C2955 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=1
[junit4] 2> 1196238 T4482 C2955 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene41VarGapFixedInterval_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C2956 name=collection1 org.apache.solr.core.SolrCore@30bd38
[junit4] 2> 1196245 T4483 C2956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196248 T4480 C2956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196250 T4481 C2956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196254 T4482 C2956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene41VarGapFixedInterval_0.tiv&checksum=true&wt=filestream&command=filecontent} status=0 QTime=1
[junit4] 2> 1196256 T4483 C2956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196258 T4480 C2956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196260 T4481 C2956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196261 T4524 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4] 2> 1196262 T4524 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4] 2> 1196263 T4524 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=44.328125, floorSegmentMB=1.5439453125, forceMergeDeletesPctAllowed=28.3197749238952, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23932644713421578
[junit4] 2> 1196263 T4524 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@ae7cf7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@dc3e2b),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@ae7cf7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@dc3e2b),segFN=segments_2,generation=2}
[junit4] 2> 1196263 T4524 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 1196264 T4524 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 1196264 T4524 oass.SolrIndexSearcher.<init> Opening Searcher@2cd52e[collection1] main
[junit4] 2> 1196264 T4522 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2cd52e[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C3))}
[junit4] 2> 1196264 T4524 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/data/index.20140528223409627 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/data/index.20140528223409627;done=true>>]
[junit4] 2> 1196265 T4524 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/data/index.20140528223409627
[junit4] 2> ASYNC NEW_CORE C2957 name=collection1 org.apache.solr.core.SolrCore@2ac135
[junit4] 2> 1196265 T4518 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:40222/solr/replication&command=fetchindex} status=0 QTime=42
[junit4] 2> 1196272 T4519 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=3 status=0 QTime=1
[junit4] 2> 1196273 T4527 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 1196274 T4527 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 1196274 T4520 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1196275 T4527 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4] 2> 1196275 T4527 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4] 2> 1196275 T4527 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4] 2> 1196277 T4517 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=0
[junit4] 2> 1196278 T4527 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 10
[junit4] 2> 1196278 T4527 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index.20140528223409675
[junit4] 2> 1196278 T4527 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4] 2> 1196278 T4527 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 1196278 T4527 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 1196279 T4527 oash.SnapPuller.fetchLatestIndex Starting download to MockDirectoryWrapper(RAMDirectory@1e9e576 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1451fae) fullCopy=false
[junit4] 2> 1196280 T4518 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene41VarGapFixedInterval_0.tib&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196283 T4519 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196285 T4520 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene41VarGapFixedInterval_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196287 T4517 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196289 T4518 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196291 T4519 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196293 T4520 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene41VarGapFixedInterval_0.tiv&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196296 T4517 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196298 T4518 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196300 T4519 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196301 T4527 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4] 2> 1196302 T4527 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4] 2> 1196302 T4527 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=44.328125, floorSegmentMB=1.5439453125, forceMergeDeletesPctAllowed=28.3197749238952, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23932644713421578
[junit4] 2> 1196303 T4527 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@13a68a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@aeb613),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@13a68a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@aeb613),segFN=segments_2,generation=2}
[junit4] 2> 1196303 T4527 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 1196303 T4527 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 1196304 T4527 oass.SolrIndexSearcher.<init> Opening Searcher@1e94e2b[collection1] main
[junit4] 2> 1196304 T4510 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e94e2b[collection1] main{UninvertingDirectoryReader(Uninverting(_0(5.0):C3))}
[junit4] 2> 1196304 T4527 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index.20140528223409675 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index.20140528223409675;done=true>>]
[junit4] 2> 1196304 T4527 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index.20140528223409675
[junit4] 2> ASYNC NEW_CORE C2958 name=collection1 org.apache.solr.core.SolrCore@c29e4f
[junit4] 2> 1196305 T4505 C2958 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wait=true&masterUrl=http://127.0.0.1:41739/solr/replication&command=fetchindex} status=0 QTime=32
[junit4] 2> 1196307 T4506 C2958 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=3 status=0 QTime=0
[junit4] 2> 1196309 T4482 C2956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
[junit4] 2> 1196311 T4483 C2956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
[junit4] 2> 1196315 T4520 C2957 oash.ReplicationHandler.getReplicationDetails WARN Exception while invoking 'details' method for replication on master org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:TEST_PORT/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:560)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
[junit4] 2> at org.apache.solr.handler.SnapPuller.getDetails(SnapPuller.java:1657)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.getReplicationDetails(ReplicationHandler.java:658)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:263)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1980)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:772)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:420)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.net.ConnectException: Connection refused
[junit4] 2> at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] 2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345)
[junit4] 2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
[junit4] 2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
[junit4] 2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
[junit4] 2> at java.net.Socket.connect(Socket.java:589)
[junit4] 2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:117)
[junit4] 2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:178)
[junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:610)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:445)
[junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:452)
[junit4] 2> ... 35 more
[junit4] 2>
[junit4] 2> 1196316 T4520 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=3
[junit4] 2> 1196318 T4480 C2956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=assertVersions&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1196320 T4517 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=assertVersions&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1196323 T4518 C2957 oash.ReplicationHandler.getReplicationDetails WARN Exception while invoking 'details' method for replication on master org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:TEST_PORT/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:560)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
[junit4] 2> at org.apache.solr.handler.SnapPuller.getDetails(SnapPuller.java:1657)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.getReplicationDetails(ReplicationHandler.java:658)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:263)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1980)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:772)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:420)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.net.ConnectException: Connection refused
[junit4] 2> at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] 2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345)
[junit4] 2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
[junit4] 2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
[junit4] 2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
[junit4] 2> at java.net.Socket.connect(Socket.java:589)
[junit4] 2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:117)
[junit4] 2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:178)
[junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:610)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:445)
[junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:452)
[junit4] 2> ... 35 more
[junit4] 2>
[junit4] 2> 1196326 T4518 C2957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=4
[junit4] 2> 1196328 T4519 C2957 oash.ReplicationHandler.getReplicationDetails WARN Exception while invoking 'details' method for replication on master org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:TEST_PORT/solr
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:560)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
[junit4] 2> at org.apache.solr.handler.SnapPuller.getDetails(SnapPuller.java:1657)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.getReplicationDetails(ReplicationHandler.java:658)
[junit4] 2> at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:263)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1980)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:772)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:420)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:136)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
[junit4] 2> at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] 2> at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] 2> at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] 2> at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.net.ConnectException: Connection refused
[junit4] 2> at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4] 2> at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345)
[junit4] 2> at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
[junit4] 2> at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
[junit4] 2> at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
[junit4] 2> at java.net.Socket.connect(Socket.java:589)
[junit4] 2> at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:117)
[junit4] 2> at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:178)
[junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:610)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:445)
[junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:452)
[junit4] 2> ... 35 more
[junit4] 2>
[junit4] 2> ASYNC NEW_CORE C2959 name=collection1 org.apache.solr.core.SolrCore@2ac135
[junit4] 2> 1196334 T4519 C2959 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=7
[junit4] 2> 1196339 T4520 C2959 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C2960 name=collection1 org.apache.solr.core.SolrCore@c29e4f
[junit4] 2> 1196340 T4507 C2960 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=getDetails&qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=4
[junit4] 2> 1196342 T4517 C2959 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=assertVersions&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1196344 T4508 C2960 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={_trace=assertVersions&qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1196346 T4518 C2959 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 0
[junit4] 2> 1196348 T4519 C2959 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
[junit4] 2> 1196350 T4520 C2959 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4] 2> 1196352 T4517 C2959 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
[junit4] 2> 1196353 T4518 C2959 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 1196355 T4518 C2959 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@ae7cf7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@dc3e2b),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@ae7cf7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@dc3e2b),segFN=segments_3,generation=3}
[junit4] 2> 1196355 T4518 C2959 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 1196356 T4518 C2959 oass.SolrIndexSearcher.<init> Opening Searcher@1ea92bd[collection1] main
[junit4] 2> 1196357 T4518 C2959 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 1196357 T4522 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ea92bd[collection1] main{UninvertingDirectoryReader(Uninverting(_1(5.0):C4))}
[junit4] 2> 1196357 T4518 C2959 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 4
[junit4] 2> 1196359 T4529 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 1196359 T4529 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> ASYNC NEW_CORE C2961 name=collection1 org.apache.solr.core.SolrCore@30bd38
[junit4] 2> 1196361 T4481 C2961 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1196361 T4529 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4] 2> 1196361 T4529 oash.SnapPuller.fetchLatestIndex Slave's generation: 3
[junit4] 2> 1196361 T4529 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4] 2> 1196364 T4482 C2961 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=1
[junit4] 2> 1196364 T4529 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 10
[junit4] 2> 1196364 T4529 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-003/collection1/data/index.20140528223409761
[junit4] 2> 1196365 T4529 oash.SnapPuller.fetchLatestIndex Starting download to MockDirectoryWrapper(RAMDirectory@1c9b9ef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@47b1e5) fullCopy=true
[junit4] 2> 1196366 T4483 C2961 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene41VarGapFixedInterval_0.tib&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 1196370 T4480 C2961 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=
[...truncated too long message...]
rDown ###Ending testEmptyCommits
[junit4] 2> 1228336 T4474 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=10127591
[junit4] 2> 1228336 T4474 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@9a71df
[junit4] 2> 1228337 T4474 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=4,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 1228337 T4474 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1228338 T4474 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1228338 T4474 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1228339 T4474 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1228339 T4474 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1228340 T4474 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/index;done=false>>]
[junit4] 2> 1228340 T4474 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data/index
[junit4] 2> 1228340 T4474 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data;done=false>>]
[junit4] 2> 1228341 T4474 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-001/collection1/data
[junit4] 2> 1228341 T4474 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 1228414 T4474 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=24042755
[junit4] 2> 1228415 T4474 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@df56b
[junit4] 2> 1228415 T4474 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 1228416 T4474 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1228416 T4474 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1228417 T4474 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1228417 T4474 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1228418 T4474 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1228418 T4474 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data;done=false>>]
[junit4] 2> 1228418 T4474 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data
[junit4] 2> 1228419 T4474 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index;done=false>>]
[junit4] 2> 1228419 T4474 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001/solr-instance-002/collection1/data/index
[junit4] 2> 1228419 T4474 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 1228483 T4474 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.handler.TestReplicationHandler-4C8AB86F544D2CD0-001
[junit4] 2> NOTE: test params are: codec=Lucene46: {name=PostingsFormat(name=Lucene41VarGapFixedInterval), id=PostingsFormat(name=Lucene41VarGapFixedInterval), newname=PostingsFormat(name=Lucene41VarGapFixedInterval)}, docValues:{}, sim=DefaultSimilarity, locale=es_UY, timezone=Europe/Bratislava
[junit4] 2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.8.0_20-ea (32-bit)/cpus=8,threads=1,free=86392336,total=228933632
[junit4] 2> NOTE: All tests run in this JVM: [TestSuggestSpellingConverter, TestSystemIdResolver, TestBadConfig, TestFieldSortValues, ExpressionTest, BadComponentTest, RAMDirectoryFactoryTest, TestLFUCache, DistributedQueryElevationComponentTest, TestCloudInspectUtil, TestReloadAndDeleteDocs, TestFieldCollectionResource, ClusterStateUpdateTest, ShardRoutingTest, UnloadDistributedZkTest, EchoParamsTest, TestCollationFieldDocValues, TestPHPSerializedResponseWriter, TestSurroundQueryParser, OverseerRolesTest, TestSchemaResource, TestSolrXml, ZkCLITest, TestBlendedInfixSuggestions, SolrInfoMBeanTest, SchemaVersionSpecificBehaviorTest, QueryElevationComponentTest, SimpleFacetsTest, TestGroupingSearch, HdfsChaosMonkeySafeLeaderTest, TestTrie, JsonLoaderTest, CursorPagingTest, TestValueSourceCache, RangeFacetTest, SynonymTokenizerTest, AnalysisAfterCoreReloadTest, AsyncMigrateRouteKeyTest, RemoteQueryErrorTest, TestStressVersions, LoggingHandlerTest, TestLuceneMatchVersion, URLClassifyProcessorTest, TestBM25SimilarityFactory, SolrIndexSplitterTest, TestRequestStatusCollectionAPI, DistributedSpellCheckComponentTest, TermVectorComponentTest, BadCopyFieldTest, TimeZoneUtilsTest, SearchHandlerTest, HdfsCollectionsAPIDistributedZkTest, TestCollectionAPI, SyncSliceTest, CollectionsAPIAsyncDistributedZkTest, TestUtils, HdfsDirectoryTest, TestSearcherReuse, TestWriterPerf, HdfsBasicDistributedZk2Test, ShowFileRequestHandlerTest, TestSolrDeletionPolicy1, DistributedDebugComponentTest, TestNonDefinedSimilarityFactory, RankQueryTest, TestShardHandlerFactory, TestConfig, SpatialFilterTest, CachingDirectoryFactoryTest, CircularListTest, BinaryUpdateRequestHandlerTest, TestSort, ShardSplitTest, TestFastLRUCache, SOLR749Test, TestSolrQueryParser, RecoveryZkTest, OverseerStatusTest, FastVectorHighlighterTest, SolrXmlInZkTest, TestDefaultSearchFieldResource, SuggesterTest, PreAnalyzedFieldTest, TestRandomMergePolicy, CSVRequestHandlerTest, ExternalFileFieldSortTest, TestSearchPerf, TestFunctionQuery, OverseerTest, SolrCoreTest, SampleTest, AssignTest, TestHighlightDedupGrouping, TestStressUserVersions, TestSolrXmlPersistence, BasicDistributedZkTest, BasicDistributedZk2Test, OpenCloseCoreStressTest, TestReplicationHandler]
[junit4] Completed on J0 in 32.71s, 14 tests, 1 error <<< FAILURES!
[...truncated 608 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 1 error, 36 ignored (15 assumptions)
Total time: 66 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0_20-ea-b15 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20-ea-b15) -
Build # 10409 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10409/
Java: 32bit/jdk1.8.0_20-ea-b15 -server -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard3 is not consistent. Got 154 from http://127.0.0.1:57624/collection1lastClient and got 150 from http://127.0.0.1:54595/collection1
Stack Trace:
java.lang.AssertionError: shard3 is not consistent. Got 154 from http://127.0.0.1:57624/collection1lastClient and got 150 from http://127.0.0.1:54595/collection1
at __randomizedtesting.SeedInfo.seed([C7FF86D549E5328B:461908CD3EBA52B7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1131)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1110)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11138 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/init-core-data-001
[junit4] 2> 668533 T2725 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 668533 T2725 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 668537 T2725 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 668537 T2725 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 668538 T2726 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 668638 T2725 oasc.ZkTestServer.run start zk server on port:40815
[junit4] 2> 668639 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 668694 T2732 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f1b61d name:ZooKeeperConnection Watcher:127.0.0.1:40815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 668695 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 668695 T2725 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 668699 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 668700 T2734 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3888cd name:ZooKeeperConnection Watcher:127.0.0.1:40815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 668700 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 668701 T2725 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 668702 T2725 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 668703 T2725 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 668705 T2725 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 668706 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 668706 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 668708 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 668709 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 668711 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 668711 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 668712 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 668713 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 668714 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 668715 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 668716 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 668716 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 668718 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 668718 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 668720 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 668720 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 668723 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 668723 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 668726 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 668727 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 668728 T2725 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 668728 T2725 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 668977 T2725 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 668981 T2725 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50442
[junit4] 2> 668982 T2725 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 668982 T2725 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 668982 T2725 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-002
[junit4] 2> 668983 T2725 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-002/'
[junit4] 2> 668993 T2725 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-002/solr.xml
[junit4] 2> 669005 T2725 oasc.CoreContainer.<init> New CoreContainer 25373085
[junit4] 2> 669005 T2725 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-002/]
[junit4] 2> 669006 T2725 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 669006 T2725 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 669006 T2725 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 669007 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 669007 T2725 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 669007 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 669007 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 669008 T2725 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 669008 T2725 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 669009 T2725 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 669009 T2725 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 669009 T2725 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 669010 T2725 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40815/solr
[junit4] 2> 669010 T2725 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 669010 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 669012 T2745 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15ae997 name:ZooKeeperConnection Watcher:127.0.0.1:40815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 669012 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 669014 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 669015 T2747 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ac69ae name:ZooKeeperConnection Watcher:127.0.0.1:40815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 669015 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 669016 T2725 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 669018 T2725 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 669020 T2725 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 669022 T2725 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 669024 T2725 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 669026 T2725 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 669027 T2725 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50442_
[junit4] 2> 669027 T2725 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50442_
[junit4] 2> 669029 T2725 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 669030 T2725 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 669035 T2725 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:50442_
[junit4] 2> 669036 T2725 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 669037 T2725 oasc.Overseer.start Overseer (id=91835670404661251-127.0.0.1:50442_-n_0000000000) starting
[junit4] 2> 669039 T2725 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 669045 T2749 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 669046 T2725 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 669047 T2725 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 669049 T2725 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 669050 T2748 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 669052 T2750 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 669052 T2750 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 669053 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 669053 T2750 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 669053 T2748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 669054 T2748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50442",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50442_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 669054 T2748 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 669054 T2748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 669056 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 669057 T2747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 670053 T2750 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 670053 T2750 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 670054 T2750 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 670054 T2750 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 670055 T2750 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 670055 T2750 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-002/collection1/'
[junit4] 2> 670056 T2750 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 670056 T2750 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 670056 T2750 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 670075 T2750 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 670083 T2750 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 670084 T2750 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 670092 T2750 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 670207 T2750 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 670208 T2750 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 670209 T2750 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 670212 T2750 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 670223 T2750 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 670224 T2750 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 670234 T2750 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/control/data/
[junit4] 2> 670235 T2750 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@81c08c
[junit4] 2> 670235 T2750 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/control/data
[junit4] 2> 670236 T2750 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/control/data/index/
[junit4] 2> 670236 T2750 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 670237 T2750 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/control/data/index
[junit4] 2> 670238 T2750 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=22.244140625, floorSegmentMB=1.140625, forceMergeDeletesPctAllowed=1.3790360644013333, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.199083730755038
[junit4] 2> 670241 T2750 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 670241 T2750 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 670243 T2750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 670243 T2750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 670244 T2750 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 670244 T2750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 670244 T2750 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 670244 T2750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 670244 T2750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 670245 T2750 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 670245 T2750 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 670245 T2750 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 670245 T2750 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 670245 T2750 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 670246 T2750 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 670246 T2750 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 670246 T2750 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 670246 T2750 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 670247 T2750 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 670248 T2750 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 670249 T2750 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 670249 T2750 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 670250 T2750 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=228981801, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 670251 T2750 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 670251 T2750 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 670251 T2750 oass.SolrIndexSearcher.<init> Opening Searcher@176c855[collection1] main
[junit4] 2> 670251 T2750 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 670252 T2750 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 670252 T2750 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 670253 T2750 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 670253 T2750 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 670253 T2750 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 670253 T2750 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 670254 T2750 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 670254 T2750 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 670254 T2750 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 670255 T2751 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@176c855[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 670256 T2750 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 670257 T2754 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50442 collection:control_collection shard:shard1
[junit4] 2> 670257 T2725 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 670258 T2754 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 670258 T2725 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 670259 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 670260 T2756 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a9d9fe name:ZooKeeperConnection Watcher:127.0.0.1:40815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 670260 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 670261 T2725 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 670265 T2754 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 670265 T2725 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 670266 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 670267 T2754 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 670267 T2754 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C4099 name=collection1 org.apache.solr.core.SolrCore@106e820 url=http://127.0.0.1:50442/collection1 node=127.0.0.1:50442_ C4099_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:50442, core=collection1, node_name=127.0.0.1:50442_}
[junit4] 2> 670267 T2754 C4099 P50442 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50442/collection1/
[junit4] 2> 670267 T2748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 670267 T2754 C4099 P50442 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 670268 T2754 C4099 P50442 oasc.SyncStrategy.syncToMe http://127.0.0.1:50442/collection1/ has no replicas
[junit4] 2> 670268 T2754 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50442/collection1/ shard1
[junit4] 2> 670268 T2754 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 670270 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 670271 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 670273 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 670374 T2747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 670374 T2756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 670422 T2754 oasc.ZkController.register We are http://127.0.0.1:50442/collection1/ and leader is http://127.0.0.1:50442/collection1/
[junit4] 2> 670423 T2754 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50442
[junit4] 2> 670423 T2754 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 670423 T2754 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 670423 T2754 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 670425 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 670425 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 670425 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 670425 T2754 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 670426 T2748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 670426 T2748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:50442",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50442_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 670428 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 670531 T2756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 670531 T2747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 670581 T2725 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 670581 T2725 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 670584 T2725 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39398
[junit4] 2> 670584 T2725 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 670585 T2725 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 670585 T2725 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-003
[junit4] 2> 670585 T2725 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-003/'
[junit4] 2> 670595 T2725 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-003/solr.xml
[junit4] 2> 670613 T2725 oasc.CoreContainer.<init> New CoreContainer 31902124
[junit4] 2> 670613 T2725 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-003/]
[junit4] 2> 670614 T2725 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 670614 T2725 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 670615 T2725 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 670615 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 670615 T2725 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 670615 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 670616 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 670616 T2725 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 670616 T2725 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 670617 T2725 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 670617 T2725 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 670617 T2725 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 670618 T2725 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40815/solr
[junit4] 2> 670618 T2725 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 670619 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 670621 T2767 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fa99ef name:ZooKeeperConnection Watcher:127.0.0.1:40815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 670621 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 670623 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 670624 T2769 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8c39e9 name:ZooKeeperConnection Watcher:127.0.0.1:40815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 670624 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 670628 T2725 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 671629 T2725 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39398_
[junit4] 2> 671631 T2725 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39398_
[junit4] 2> 671637 T2770 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 671637 T2770 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 671638 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 671638 T2770 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 671638 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 671639 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 671640 T2748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 671641 T2748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39398",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39398_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 671641 T2748 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 671641 T2748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 671645 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 671746 T2756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 671746 T2747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 671746 T2769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 672639 T2770 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 672639 T2770 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 672639 T2770 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 672640 T2770 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 672641 T2770 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 672641 T2770 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-003/collection1/'
[junit4] 2> 672641 T2770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 672641 T2770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 672642 T2770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 672669 T2770 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 672682 T2770 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 672683 T2770 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 672686 T2770 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 672785 T2770 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 672786 T2770 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 672787 T2770 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 672789 T2770 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 672803 T2770 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 672803 T2770 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 672803 T2770 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty1/
[junit4] 2> 672803 T2770 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@81c08c
[junit4] 2> 672804 T2770 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty1
[junit4] 2> 672804 T2770 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty1/index/
[junit4] 2> 672804 T2770 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 672805 T2770 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty1/index
[junit4] 2> 672806 T2770 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=22.244140625, floorSegmentMB=1.140625, forceMergeDeletesPctAllowed=1.3790360644013333, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.199083730755038
[junit4] 2> 672915 T2770 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 672916 T2770 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 672918 T2770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 672919 T2770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 672919 T2770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 672919 T2770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 672919 T2770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 672920 T2770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 672920 T2770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 672920 T2770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 672920 T2770 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 672921 T2770 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 672921 T2770 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 672921 T2770 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 672921 T2770 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 672922 T2770 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 672922 T2770 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 672922 T2770 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 672923 T2770 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 672924 T2770 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 672925 T2770 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 672926 T2770 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 672927 T2770 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=228981801, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 672928 T2770 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 672928 T2770 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 672928 T2770 oass.SolrIndexSearcher.<init> Opening Searcher@102fe2b[collection1] main
[junit4] 2> 672928 T2770 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 672930 T2770 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 672930 T2770 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 672930 T2770 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 672931 T2770 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 672931 T2770 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 672932 T2770 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 672932 T2770 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 672932 T2770 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 672932 T2770 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 672934 T2771 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@102fe2b[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 672935 T2770 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 672936 T2774 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39398 collection:collection1 shard:shard2
[junit4] 2> 672936 T2725 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 672937 T2774 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 672937 T2725 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 672946 T2774 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 672948 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 672948 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 672948 T2774 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 672949 T2748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 672948 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 672949 T2774 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C4100 name=collection1 org.apache.solr.core.SolrCore@c97de3 url=http://127.0.0.1:39398/collection1 node=127.0.0.1:39398_ C4100_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:39398, core=collection1, node_name=127.0.0.1:39398_}
[junit4] 2> 672950 T2774 C4100 P39398 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39398/collection1/
[junit4] 2> 672950 T2774 C4100 P39398 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 672950 T2774 C4100 P39398 oasc.SyncStrategy.syncToMe http://127.0.0.1:39398/collection1/ has no replicas
[junit4] 2> 672951 T2774 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39398/collection1/ shard2
[junit4] 2> 672951 T2774 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 672951 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 672953 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 672955 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673057 T2756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 673057 T2769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 673057 T2747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 673104 T2774 oasc.ZkController.register We are http://127.0.0.1:39398/collection1/ and leader is http://127.0.0.1:39398/collection1/
[junit4] 2> 673105 T2774 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39398
[junit4] 2> 673105 T2774 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 673111 T2774 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 673111 T2774 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 673112 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673112 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673113 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673112 T2774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 673113 T2748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 673113 T2748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:39398",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:39398_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 673115 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 673179 T2725 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 673180 T2725 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 673182 T2725 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57624
[junit4] 2> 673183 T2725 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 673183 T2725 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 673183 T2725 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-004
[junit4] 2> 673184 T2725 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-004/'
[junit4] 2> 673194 T2725 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-004/solr.xml
[junit4] 2> 673205 T2725 oasc.CoreContainer.<init> New CoreContainer 14762086
[junit4] 2> 673206 T2725 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-004/]
[junit4] 2> 673206 T2725 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 673206 T2725 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 673207 T2725 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 673207 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 673207 T2725 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 673207 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 673208 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 673208 T2725 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 673208 T2725 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 673209 T2725 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 673209 T2725 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 673210 T2725 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 673210 T2725 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40815/solr
[junit4] 2> 673210 T2725 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 673211 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 673213 T2785 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13ec6e1 name:ZooKeeperConnection Watcher:127.0.0.1:40815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 673213 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 673215 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 673216 T2787 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75f81a name:ZooKeeperConnection Watcher:127.0.0.1:40815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 673216 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 673220 T2769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 673220 T2756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 673220 T2747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 673224 T2725 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 674227 T2725 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57624_
[junit4] 2> 674228 T2725 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57624_
[junit4] 2> 674235 T2788 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 674235 T2788 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 674236 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 674236 T2788 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 674237 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 674237 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 674238 T2748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 674238 T2748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:57624",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:57624_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 674239 T2748 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 674239 T2748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 674248 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 674349 T2769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 674349 T2787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 674350 T2747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 674350 T2756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675237 T2788 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 675237 T2788 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 675238 T2788 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 675238 T2788 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 675239 T2788 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 675239 T2788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-004/collection1/'
[junit4] 2> 675240 T2788 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 675240 T2788 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 675241 T2788 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 675275 T2788 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 675295 T2788 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 675296 T2788 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 675302 T2788 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 675436 T2788 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 675438 T2788 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 675438 T2788 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 675441 T2788 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 675458 T2788 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 675458 T2788 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 675459 T2788 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty2/
[junit4] 2> 675460 T2788 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@81c08c
[junit4] 2> 675461 T2788 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty2
[junit4] 2> 675461 T2788 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty2/index/
[junit4] 2> 675461 T2788 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 675462 T2788 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty2/index
[junit4] 2> 675463 T2788 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=22.244140625, floorSegmentMB=1.140625, forceMergeDeletesPctAllowed=1.3790360644013333, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.199083730755038
[junit4] 2> 675468 T2788 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 675468 T2788 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 675472 T2788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 675473 T2788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 675473 T2788 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 675473 T2788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 675474 T2788 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 675474 T2788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 675474 T2788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 675475 T2788 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 675475 T2788 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 675476 T2788 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 675476 T2788 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 675476 T2788 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 675477 T2788 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 675477 T2788 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 675477 T2788 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 675478 T2788 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 675478 T2788 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 675481 T2788 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 675483 T2788 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 675483 T2788 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 675484 T2788 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=228981801, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 675485 T2788 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 675485 T2788 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 675486 T2788 oass.SolrIndexSearcher.<init> Opening Searcher@1720160[collection1] main
[junit4] 2> 675486 T2788 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 675489 T2788 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 675490 T2788 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 675490 T2788 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 675490 T2788 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 675490 T2788 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 675491 T2788 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 675491 T2788 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 675491 T2788 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 675491 T2788 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 675494 T2789 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1720160[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 675515 T2788 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 675516 T2725 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 675517 T2725 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 675520 T2792 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57624 collection:collection1 shard:shard3
[junit4] 2> 675524 T2792 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 675530 T2792 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 675533 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 675533 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 675533 T2792 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 675534 T2792 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 675533 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C4101 name=collection1 org.apache.solr.core.SolrCore@1319eb4 url=http://127.0.0.1:57624/collection1 node=127.0.0.1:57624_ C4101_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:57624, core=collection1, node_name=127.0.0.1:57624_}
[junit4] 2> 675534 T2792 C4101 P57624 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57624/collection1/
[junit4] 2> 675535 T2792 C4101 P57624 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 675535 T2748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 675535 T2792 C4101 P57624 oasc.SyncStrategy.syncToMe http://127.0.0.1:57624/collection1/ has no replicas
[junit4] 2> 675535 T2792 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57624/collection1/ shard3
[junit4] 2> 675535 T2792 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 675538 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 675540 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 675545 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 675648 T2756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675648 T2787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675648 T2747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675648 T2769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675692 T2792 oasc.ZkController.register We are http://127.0.0.1:57624/collection1/ and leader is http://127.0.0.1:57624/collection1/
[junit4] 2> 675692 T2792 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57624
[junit4] 2> 675692 T2792 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 675693 T2792 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 675693 T2792 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 675694 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 675694 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 675694 T2792 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 675695 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 675696 T2748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 675697 T2748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:57624",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:57624_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 675698 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 675802 T2756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675802 T2747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675802 T2787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675802 T2769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 675984 T2725 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 675985 T2725 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 675987 T2725 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56167
[junit4] 2> 675988 T2725 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 675989 T2725 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 675989 T2725 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-005
[junit4] 2> 675990 T2725 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-005/'
[junit4] 2> 676007 T2725 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-005/solr.xml
[junit4] 2> 676024 T2725 oasc.CoreContainer.<init> New CoreContainer 16664471
[junit4] 2> 676025 T2725 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-005/]
[junit4] 2> 676026 T2725 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 676026 T2725 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 676027 T2725 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 676027 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 676028 T2725 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 676028 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 676029 T2725 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 676029 T2725 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 676029 T2725 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 676030 T2725 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 676031 T2725 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 676031 T2725 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 676032 T2725 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:40815/solr
[junit4] 2> 676032 T2725 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 676033 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 676035 T2803 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8582b name:ZooKeeperConnection Watcher:127.0.0.1:40815 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 676036 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 676050 T2725 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 676051 T2805 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@add6c6 name:ZooKeeperConnection Watcher:127.0.0.1:40815/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 676051 T2725 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 676057 T2725 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 677063 T2725 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56167_
[junit4] 2> 677065 T2725 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56167_
[junit4] 2> 677075 T2806 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 677075 T2806 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 677076 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 677076 T2806 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 677076 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 677077 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 677078 T2748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 677078 T2748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56167",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56167_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 677079 T2748 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 677083 T2748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 677085 T2747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 677272 T2805 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 677272 T2769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 677272 T2756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 677273 T2747 oa
[...truncated too long message...]
g to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty10/index.20140528211934833 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty10/index.20140528211934833;done=false>>]
[junit4] 2> 783384 T3152 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty10/index.20140528211934833
[junit4] 2> 783384 T3152 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 783384 T3152 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> ASYNC NEW_CORE C4986 name=collection1 org.apache.solr.core.SolrCore@13732db url=http://127.0.0.1:38804/collection1 node=127.0.0.1:38804_ C4986_STATE=coll:collection1 core:collection1 props:{state=active, base_url=http://127.0.0.1:38804, core=collection1, node_name=127.0.0.1:38804_}
[junit4] 2> 783457 T3227 C4986 P38804 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 783457 T3227 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 783458 T3227 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@13732db
[junit4] 2> 783459 T3227 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=22,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=73,cumulative_deletesById=43,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=7898,transaction_logs_total_number=2}
[junit4] 2> 783459 T3227 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 783459 T3227 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 783459 T3227 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 783461 T3227 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 783461 T3227 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 783462 T3227 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty11 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty11;done=false>>]
[junit4] 2> 783462 T3227 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty11
[junit4] 2> 783462 T3227 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty11/index.20140528211927102 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty11/index.20140528211927102;done=false>>]
[junit4] 2> 783462 T3227 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001/tempDir-001/jetty11/index.20140528211927102
[junit4] 2> 783462 T3227 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-C7FF86D549E5328B-001
[junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=366), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=366)), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=en_CA, timezone=Europe/Bucharest
[junit4] 2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.8.0_20-ea (32-bit)/cpus=8,threads=1,free=88423008,total=223383552
[junit4] 2> NOTE: All tests run in this JVM: [SolrTestCaseJ4Test, JSONWriterTest, TestSweetSpotSimilarityFactory, SimplePostToolTest, DocValuesMultiTest, DocumentAnalysisRequestHandlerTest, BlockCacheTest, TestSchemaNameResource, TestDFRSimilarityFactory, TestCoreDiscovery, TestDistributedGrouping, TestWordDelimiterFilterFactory, TestIndexingPerformance, TestOmitPositions, TestFastOutputStream, ZkNodePropsTest, StandardRequestHandlerTest, TestXIncludeConfig, TestCollationField, TestFileDictionaryLookup, TestFiltering, TestPartialUpdateDeduplication, LegacyHTMLStripCharFilterTest, HdfsLockFactoryTest, MultiTermTest, TestRecoveryHdfs, TestFreeTextSuggestions, CollectionsAPIDistributedZkTest, TestUniqueKeyFieldResource, TestSolr4Spatial, TestLMDirichletSimilarityFactory, DistributedSuggestComponentTest, DateMathParserTest, TestReload, SolrCmdDistributorTest, DirectSolrConnectionTest, ResourceLoaderTest, PluginInfoTest, TestOverriddenPrefixQueryForCustomFieldType, DeleteReplicaTest, TestQuerySenderListener, TestSchemaSimilarityResource, HardAutoCommitTest, DeleteShardTest, TestManagedResourceStorage, BadIndexSchemaTest, IndexBasedSpellCheckerTest, BasicZkTest, ShardRoutingCustomTest, TestRecovery, BlockDirectoryTest, ZkSolrClientTest, TestAtomicUpdateErrorCases, ParsingFieldUpdateProcessorsTest, RequiredFieldsTest, TestRTGBase, AddBlockUpdateTest, TestCloudManagedSchemaAddField, TestQuerySenderNoQuery, SortByFunctionTest, TestJmxIntegration, TestManagedStopFilterFactory, TestPhraseSuggestions, HighlighterTest, TestRandomFaceting, TestIBSimilarityFactory, SolrPluginUtilsTest, TestIndexSearcher, OpenExchangeRatesOrgProviderTest, BasicDistributedZk2Test, DistanceFunctionTest, ConvertedLegacyTest, TermVectorComponentDistributedTest, HdfsUnloadDistributedZkTest, ResponseHeaderTest, SuggesterTSTTest, TestDynamicFieldCollectionResource, TestSolrCoreProperties, TestStandardQParsers, TestClassNameShortening, OpenCloseCoreStressTest, ChangedSchemaMergeTest, SystemInfoHandlerTest, DocExpirationUpdateProcessorFactoryTest, DocValuesMissingTest, TestHighFrequencyDictionaryFactory, DOMUtilTest, StatsComponentTest, CurrencyFieldOpenExchangeTest, TestFuzzyAnalyzedSuggestions, HighlighterConfigTest, TestCloudManagedSchema, TestSolrXMLSerializer, TestRangeQuery, TestDocumentBuilder, TestCollapseQParserPlugin, MigrateRouteKeyTest, TestManagedSynonymFilterFactory, DirectUpdateHandlerTest, ChaosMonkeySafeLeaderTest]
[junit4] Completed on J1 in 115.55s, 1 test, 1 failure <<< FAILURES!
[...truncated 655 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 1 failure, 36 ignored (15 assumptions)
Total time: 71 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0_20-ea-b15 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure