You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/08/16 05:44:19 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0-ea-b102) - Build # 7030 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/7030/
Java: 32bit/jdk1.8.0-ea-b102 -server -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.handler.TestReplicationHandler.doTestStressReplication

Error Message:
timed out waiting for collection1 startAt time to exceed: Fri Aug 16 07:39:31 VOLT 2013

Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Fri Aug 16 07:39:31 VOLT 2013
	at __randomizedtesting.SeedInfo.seed([D1277293D8855FDC:A8C7255DDAD366F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1513)
	at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:817)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:491)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:724)




Build Log:
[...truncated 9905 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4]   2> 682243 T2138 oas.SolrTestCaseJ4.setUp ###Starting doTestDetails
   [junit4]   2> 682246 T2138 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 682251 T2138 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50331
   [junit4]   2> 682253 T2138 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 682253 T2138 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 682253 T2138 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master
   [junit4]   2> 682254 T2138 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/'
   [junit4]   2> 682262 T2138 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/solr.xml
   [junit4]   2> 682263 T2138 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/solr.xml does not exist, using default configuration
   [junit4]   2> 682269 T2138 oasc.CoreContainer.<init> New CoreContainer 10626244
   [junit4]   2> 682269 T2138 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/]
   [junit4]   2> 682269 T2138 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 682270 T2138 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 682270 T2138 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 682270 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 682270 T2138 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 682271 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 682271 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 682271 T2138 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 682271 T2138 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 682272 T2138 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 682276 T2148 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1
   [junit4]   2> 682276 T2148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/'
   [junit4]   2> 682287 T2148 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 682300 T2148 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 682303 T2148 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 682304 T2148 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 682306 T2148 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 682307 T2148 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 682307 T2148 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data/
   [junit4]   2> 682307 T2148 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 682307 T2148 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data
   [junit4]   2> 682308 T2148 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data/index/
   [junit4]   2> 682308 T2148 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 682308 T2148 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data/index
   [junit4]   2> 682308 T2148 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d0f984 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12913cf),segFN=segments_1,generation=1}
   [junit4]   2> 682309 T2148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 682309 T2148 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 682309 T2148 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 682310 T2148 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 682310 T2148 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 682310 T2148 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 682310 T2148 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 682311 T2148 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 682312 T2148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 682313 T2148 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 682313 T2148 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 682313 T2148 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d0f984 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12913cf),segFN=segments_1,generation=1}
   [junit4]   2> 682313 T2148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 682314 T2148 oass.SolrIndexSearcher.<init> Opening Searcher@1d8046d main
   [junit4]   2> 682314 T2148 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 682314 T2148 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 682314 T2149 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d8046d main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 682314 T2148 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 682315 T2138 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 682315 T2138 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 682315 T2138 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 682320 T2138 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 682321 T2138 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:40227
   [junit4]   2> 682321 T2138 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 682322 T2138 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 682322 T2138 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave
   [junit4]   2> 682322 T2138 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/'
   [junit4]   2> 682329 T2138 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/solr.xml
   [junit4]   2> 682329 T2138 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/solr.xml does not exist, using default configuration
   [junit4]   2> 682334 T2138 oasc.CoreContainer.<init> New CoreContainer 14005706
   [junit4]   2> 682335 T2138 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/]
   [junit4]   2> 682335 T2138 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 682335 T2138 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 682335 T2138 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 682336 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 682336 T2138 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 682336 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 682336 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 682337 T2138 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 682337 T2138 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 682337 T2138 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 682340 T2160 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1
   [junit4]   2> 682340 T2160 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/'
   [junit4]   2> 682360 T2160 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 682367 T2160 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 682368 T2160 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 682370 T2160 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 682373 T2160 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 682374 T2160 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 682374 T2160 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/
   [junit4]   2> 682374 T2160 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 682375 T2160 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data
   [junit4]   2> 682375 T2160 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index/
   [junit4]   2> 682375 T2160 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 682375 T2160 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index
   [junit4]   2> 682376 T2160 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@162f1ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19580e7),segFN=segments_1,generation=1}
   [junit4]   2> 682376 T2160 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 682377 T2160 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 682377 T2160 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 682377 T2160 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 682378 T2160 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 682378 T2160 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 682378 T2160 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 682378 T2160 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 682380 T2160 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 682380 T2160 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 682381 T2160 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 682381 T2160 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@162f1ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19580e7),segFN=segments_1,generation=1}
   [junit4]   2> 682381 T2160 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 682382 T2160 oass.SolrIndexSearcher.<init> Opening Searcher@ebba07 main
   [junit4]   2> 682383 T2160 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
   [junit4]   2> 682384 T2161 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ebba07 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 682384 T2160 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 682384 T2138 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 682384 T2138 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 682385 T2138 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> ASYNC  NEW_CORE C1706 name=collection1 org.apache.solr.core.SolrCore@22dbec
   [junit4]   2> 682390 T2144 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=2 
   [junit4]   2> 682393 T2145 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
   [junit4]   2> 682395 T2146 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
   [junit4]   2> ASYNC  NEW_CORE C1707 name=collection1 org.apache.solr.core.SolrCore@1739b1b
   [junit4]   2> 682396 T2156 C1707 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
   [junit4]   2> 682398 T2147 C1706 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 0
   [junit4]   2> 682400 T2144 C1706 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 682401 T2144 C1706 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d0f984 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12913cf),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d0f984 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12913cf),segFN=segments_2,generation=2}
   [junit4]   2> 682401 T2144 C1706 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 682402 T2144 C1706 oass.SolrIndexSearcher.<init> Opening Searcher@16b11a2 main
   [junit4]   2> 682402 T2144 C1706 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 682402 T2149 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16b11a2 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c1)}
   [junit4]   2> 682402 T2144 C1706 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 2
   [junit4]   2> 682404 T2164 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 682404 T2164 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 682406 T2145 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
   [junit4]   2> 682406 T2164 oash.SnapPuller.fetchLatestIndex Master's generation: 2
   [junit4]   2> 682406 T2164 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
   [junit4]   2> 682406 T2164 oash.SnapPuller.fetchLatestIndex Starting replication process
   [junit4]   2> 682410 T2146 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2 
   [junit4]   2> 682410 T2164 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 4
   [junit4]   2> 682410 T2164 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905623
   [junit4]   2> 682410 T2164 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1684d27 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1d9b1d) fullCopy=false
   [junit4]   2> 682412 T2147 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.cfs&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 682415 T2144 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.cfe&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 682417 T2145 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 682419 T2146 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 682420 T2164 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
   [junit4]   2> 682421 T2164 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
   [junit4]   2> 682421 T2164 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 682421 T2164 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
   [junit4]   2> 682421 T2164 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
   [junit4]   2> 682422 T2164 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@162f1ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19580e7),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@162f1ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19580e7),segFN=segments_2,generation=2}
   [junit4]   2> 682422 T2164 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 682422 T2164 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 682423 T2164 oass.SolrIndexSearcher.<init> Opening Searcher@92c2d0 main
   [junit4]   2> 682423 T2161 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@92c2d0 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c1)}
   [junit4]   2> 682423 T2164 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905623 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905623;done=true>>]
   [junit4]   2> 682424 T2164 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905623
   [junit4]   2> 682424 T2157 C1707 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:50331/solr/replication&command=fetchindex&wait=true} status=0 QTime=20 
   [junit4]   2> 682429 T2147 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
   [junit4]   2> 682429 T2158 C1707 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
   [junit4]   2> 682432 T2144 C1706 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 1
   [junit4]   2> 682433 T2145 C1706 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 682435 T2145 C1706 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d0f984 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12913cf),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d0f984 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12913cf),segFN=segments_3,generation=3}
   [junit4]   2> 682435 T2145 C1706 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 682436 T2145 C1706 oass.SolrIndexSearcher.<init> Opening Searcher@f59ee main
   [junit4]   2> 682436 T2145 C1706 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 682436 T2149 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f59ee main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):c1 _1(5.0):c1)}
   [junit4]   2> 682437 T2145 C1706 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 4
   [junit4]   2> 682438 T2167 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 682438 T2167 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 682439 T2146 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
   [junit4]   2> 682440 T2167 oash.SnapPuller.fetchLatestIndex Master's generation: 3
   [junit4]   2> 682440 T2167 oash.SnapPuller.fetchLatestIndex Slave's generation: 2
   [junit4]   2> 682440 T2167 oash.SnapPuller.fetchLatestIndex Starting replication process
   [junit4]   2> 682442 T2147 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0 
   [junit4]   2> 682442 T2167 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 7
   [junit4]   2> 682443 T2167 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905656
   [junit4]   2> 682443 T2167 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@1650c95 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7ab1d2) fullCopy=false
   [junit4]   2> 682443 T2167 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfs because it already exists
   [junit4]   2> 682444 T2167 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfe because it already exists
   [junit4]   2> 682446 T2144 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=1 
   [junit4]   2> 682446 T2167 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
   [junit4]   2> 682448 T2145 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.cfs&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 682450 T2146 C1706 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> ASYNC  NEW_CORE C1708 name=collection1 org.apache.solr.core.SolrCore@22dbec
   [junit4]   2> 682463 T2147 C1708 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.cfe&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 682464 T2167 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
   [junit4]   2> 682465 T2167 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
   [junit4]   2> 682465 T2167 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 682465 T2167 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
   [junit4]   2> 682466 T2167 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
   [junit4]   2> 682466 T2167 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@162f1ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19580e7),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@162f1ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19580e7),segFN=segments_3,generation=3}
   [junit4]   2> 682467 T2167 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 682467 T2167 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 682468 T2167 oass.SolrIndexSearcher.<init> Opening Searcher@9734e2 main
   [junit4]   2> 682468 T2161 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9734e2 main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):c1 _1(5.0):c1)}
   [junit4]   2> 682468 T2167 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905656 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905656;done=true>>]
   [junit4]   2> 682468 T2167 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905656
   [junit4]   2> ASYNC  NEW_CORE C1709 name=collection1 org.apache.solr.core.SolrCore@1739b1b
   [junit4]   2> 682468 T2155 C1709 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:50331/solr/replication&command=fetchindex&wait=true} status=0 QTime=31 
   [junit4]   2> 682472 T2144 C1708 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
   [junit4]   2> 682473 T2156 C1709 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
   [junit4]   2> 682475 T2145 C1708 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 1
   [junit4]   2> 682476 T2146 C1708 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 682477 T2146 C1708 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d0f984 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12913cf),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d0f984 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12913cf),segFN=segments_3,generation=3}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1d0f984 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12913cf),segFN=segments_4,generation=4}
   [junit4]   2> 682477 T2146 C1708 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
   [junit4]   2> 682478 T2146 C1708 oass.SolrIndexSearcher.<init> Opening Searcher@1357d63 main
   [junit4]   2> 682478 T2146 C1708 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 682478 T2149 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1357d63 main{StandardDirectoryReader(segments_4:7:nrt _0(5.0):c1 _1(5.0):c1 _2(5.0):c1)}
   [junit4]   2> 682479 T2146 C1708 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 3
   [junit4]   2> 682480 T2169 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 682480 T2169 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 682481 T2147 C1708 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
   [junit4]   2> 682482 T2169 oash.SnapPuller.fetchLatestIndex Master's generation: 4
   [junit4]   2> 682482 T2169 oash.SnapPuller.fetchLatestIndex Slave's generation: 3
   [junit4]   2> 682482 T2169 oash.SnapPuller.fetchLatestIndex Starting replication process
   [junit4]   2> 682483 T2144 C1708 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=0 
   [junit4]   2> 682484 T2169 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 10
   [junit4]   2> 682484 T2169 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905697
   [junit4]   2> 682484 T2169 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@8b88ce lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2c7a60) fullCopy=false
   [junit4]   2> 682486 T2145 C1708 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 682486 T2169 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfs because it already exists
   [junit4]   2> 682487 T2169 oash.SnapPuller.downloadIndexFiles Skipping download for _0.cfe because it already exists
   [junit4]   2> 682487 T2169 oash.SnapPuller.downloadIndexFiles Skipping download for _1.si because it already exists
   [junit4]   2> 682487 T2169 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
   [junit4]   2> 682487 T2169 oash.SnapPuller.downloadIndexFiles Skipping download for _1.cfs because it already exists
   [junit4]   2> 682489 T2146 C1708 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.cfs&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=1 
   [junit4]   2> 682491 T2147 C1708 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.cfe&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 682493 T2144 C1708 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 682493 T2169 oash.SnapPuller.downloadIndexFiles Skipping download for _1.cfe because it already exists
   [junit4]   2> 682493 T2169 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
   [junit4]   2> 682494 T2169 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
   [junit4]   2> 682494 T2169 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 682494 T2169 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
   [junit4]   2> 682495 T2169 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
   [junit4]   2> 682545 T2169 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@162f1ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19580e7),segFN=segments_3,generation=3}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@162f1ac lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19580e7),segFN=segments_4,generation=4}
   [junit4]   2> 682546 T2169 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
   [junit4]   2> 682546 T2169 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 682547 T2169 oass.SolrIndexSearcher.<init> Opening Searcher@1f65aac main
   [junit4]   2> 682547 T2161 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f65aac main{StandardDirectoryReader(segments_4:7:nrt _0(5.0):c1 _1(5.0):c1 _2(5.0):c1)}
   [junit4]   2> 682547 T2169 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905697 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905697;done=true>>]
   [junit4]   2> 682547 T2169 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index.20130816073905697
   [junit4]   2> 682548 T2157 C1709 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:50331/solr/replication&command=fetchindex&wait=true} status=0 QTime=69 
   [junit4]   2> 682554 T2138 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 682555 T2138 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59556
   [junit4]   2> 682560 T2138 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 682560 T2138 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 682561 T2138 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater
   [junit4]   2> 682561 T2138 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/'
   [junit4]   2> 682571 T2138 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/solr.xml
   [junit4]   2> 682572 T2138 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/solr.xml does not exist, using default configuration
   [junit4]   2> 682579 T2138 oasc.CoreContainer.<init> New CoreContainer 10166225
   [junit4]   2> 682579 T2138 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/]
   [junit4]   2> 682580 T2138 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 682580 T2138 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 682581 T2138 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 682581 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 682581 T2138 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 682582 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 682582 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 682582 T2138 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 682583 T2138 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 682583 T2138 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 682587 T2180 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1
   [junit4]   2> 682588 T2180 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/'
   [junit4]   2> 682599 T2180 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 682615 T2180 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 682616 T2180 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 682617 T2180 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 682619 T2180 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 682619 T2180 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 682620 T2180 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data/
   [junit4]   2> 682620 T2180 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 682620 T2180 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data
   [junit4]   2> 682620 T2180 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data/index/
   [junit4]   2> 682620 T2180 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 682621 T2180 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data/index
   [junit4]   2> 682621 T2180 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f59f43 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ae441b),segFN=segments_1,generation=1}
   [junit4]   2> 682621 T2180 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 682622 T2180 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 682622 T2180 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 682622 T2180 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 682622 T2180 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 682622 T2180 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 682622 T2180 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 682623 T2180 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 682623 T2180 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 682624 T2180 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 682624 T2180 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 682625 T2180 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1f59f43 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ae441b),segFN=segments_1,generation=1}
   [junit4]   2> 682625 T2180 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 682625 T2180 oass.SolrIndexSearcher.<init> Opening Searcher@1fc8d81 main
   [junit4]   2> 682625 T2180 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 682625 T2180 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 682626 T2180 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml
   [junit4]   2> 682626 T2180 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 682626 T2180 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 682626 T2181 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1fc8d81 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 682626 T2138 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 682626 T2138 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 682627 T2138 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> ASYNC  NEW_CORE C1710 name=collection1 org.apache.solr.core.SolrCore@22dbec
   [junit4]   2> 682632 T2145 C1710 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
   [junit4]   2> ASYNC  NEW_CORE C1711 name=collection1 org.apache.solr.core.SolrCore@d1f8e2
   [junit4]   2> 682633 T2176 C1711 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=2 
   [junit4]   2> 682654 T2138 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=10166225
   [junit4]   2> 682655 T2138 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@d1f8e2
   [junit4]   2> 682655 T2138 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 682655 T2138 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 682656 T2138 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 682656 T2138 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 682656 T2138 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 682657 T2138 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 682657 T2138 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data/index;done=false>>]
   [junit4]   2> 682657 T2138 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data/index
   [junit4]   2> 682657 T2138 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data;done=false>>]
   [junit4]   2> 682658 T2138 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345761/repeater/collection1/data
   [junit4]   2> 682658 T2138 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 682710 T2138 oas.SolrTestCaseJ4.tearDown ###Ending doTestDetails
   [junit4]   2> 682731 T2138 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=10626244
   [junit4]   2> 682732 T2138 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@22dbec
   [junit4]   2> 682732 T2138 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 682732 T2138 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 682733 T2138 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 682733 T2138 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 682733 T2138 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 682734 T2138 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 682734 T2138 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data;done=false>>]
   [junit4]   2> 682734 T2138 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data
   [junit4]   2> 682735 T2138 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data/index;done=false>>]
   [junit4]   2> 682735 T2138 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345456/master/collection1/data/index
   [junit4]   2> 682735 T2138 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 682788 T2162 oash.SnapPuller.fetchLatestIndex ERROR Master at: http://127.0.0.1:50331/solr is not available. Index fetch failed. Exception: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:50331/solr
   [junit4]   2> 682806 T2138 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=14005706
   [junit4]   2> 682807 T2138 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1739b1b
   [junit4]   2> 682808 T2138 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 682808 T2138 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 682809 T2138 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 682809 T2138 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 682810 T2138 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 682810 T2138 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 682810 T2138 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index;done=false>>]
   [junit4]   2> 682811 T2138 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data/index
   [junit4]   2> 682811 T2138 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data;done=false>>]
   [junit4]   2> 682812 T2138 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624345530/slave/collection1/data
   [junit4]   2> 682812 T2138 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 682872 T2138 oas.SolrTestCaseJ4.setUp ###Starting doTestReplicateAfterWrite2Slave
   [junit4]   2> 682876 T2138 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 682878 T2138 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59762
   [junit4]   2> 682878 T2138 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 682879 T2138 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 682879 T2138 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master
   [junit4]   2> 682880 T2138 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/'
   [junit4]   2> 682893 T2138 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/solr.xml
   [junit4]   2> 682893 T2138 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/solr.xml does not exist, using default configuration
   [junit4]   2> 682901 T2138 oasc.CoreContainer.<init> New CoreContainer 4592901
   [junit4]   2> 682902 T2138 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/]
   [junit4]   2> 682902 T2138 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 682903 T2138 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 682903 T2138 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 682903 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 682904 T2138 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 682904 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 682904 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 682905 T2138 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 682905 T2138 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 682905 T2138 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 682910 T2192 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/collection1
   [junit4]   2> 682911 T2192 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/collection1/'
   [junit4]   2> 682937 T2192 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 682946 T2192 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 682946 T2192 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 682949 T2192 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 682953 T2192 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 682953 T2192 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 682954 T2192 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/collection1/data/
   [junit4]   2> 682954 T2192 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 682954 T2192 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/collection1/data
   [junit4]   2> 682955 T2192 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/collection1/data/index/
   [junit4]   2> 682955 T2192 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 682955 T2192 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346085/master/collection1/data/index
   [junit4]   2> 682956 T2192 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@af6100 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f35a70),segFN=segments_1,generation=1}
   [junit4]   2> 682956 T2192 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 682957 T2192 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 682957 T2192 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 682957 T2192 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 682957 T2192 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 682957 T2192 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 682957 T2192 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 682958 T2192 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 682959 T2192 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 682960 T2192 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 682960 T2192 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 682961 T2192 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@af6100 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f35a70),segFN=segments_1,generation=1}
   [junit4]   2> 682961 T2192 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 682961 T2192 oass.SolrIndexSearcher.<init> Opening Searcher@ac8a35 main
   [junit4]   2> 682961 T2192 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 682961 T2192 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 682962 T2192 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 682962 T2193 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ac8a35 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 682962 T2138 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 682963 T2138 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 682963 T2138 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 682970 T2138 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 682972 T2138 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60675
   [junit4]   2> 682973 T2138 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 682973 T2138 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 682974 T2138 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave
   [junit4]   2> 682974 T2138 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/'
   [junit4]   2> 682985 T2138 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/solr.xml
   [junit4]   2> 682986 T2138 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/solr.xml does not exist, using default configuration
   [junit4]   2> 682993 T2138 oasc.CoreContainer.<init> New CoreContainer 12677474
   [junit4]   2> 682993 T2138 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/]
   [junit4]   2> 682994 T2138 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 682994 T2138 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 682995 T2138 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 682995 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 682996 T2138 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 682996 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 682996 T2138 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 682997 T2138 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 682997 T2138 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 682998 T2138 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 683002 T2204 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/collection1
   [junit4]   2> 683002 T2204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/collection1/'
   [junit4]   2> 683022 T2204 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 683028 T2204 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 683029 T2204 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 683030 T2204 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 683033 T2204 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 683033 T2204 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 683033 T2204 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/collection1/data/
   [junit4]   2> 683033 T2204 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 683034 T2204 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/collection1/data
   [junit4]   2> 683034 T2204 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/collection1/data/index/
   [junit4]   2> 683034 T2204 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 683034 T2204 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624346179/slave/collection1/data/index
   [junit4]   2> 683035 T2204 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@167f64a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3555b2),segFN=segments_1,generation=1}
   [junit4]   2> 683035 T2204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 683036 T2204 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 683036 T2204 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 683036 T2204 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 683036 T2204 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 683037 T2204 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 683037 T2204 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 683037 T2204 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 683038 T2204 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 683039 T2204 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 683039 T2204 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 683039 T2204 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@167f64a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3555b2),segFN=segments_1,generation=1}
   [junit4]   2> 683040 T2204 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 683040 T2204 oass.SolrIndexSearcher.<init> Opening Searcher@13fc87b main
   [junit4]   2> 683040 T2204 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
   [junit4]   2> 683040 T2204 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 683040 T2205 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@13fc87b main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 683041 T2138 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 683041 T2138 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 683042 T2138 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> ASYNC  NEW_CORE C1712 name=collection1 org.apache.solr.core.SolrCore@61be0a
   [junit4]   2> 683046 T2188 C1712 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 683049 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 0
   [junit4]   2> 683051 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
   [junit4]   2> 683052 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
   [junit4]   2> 683054 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
   [junit4]   2> 683055 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
   [junit4]   2> 683057 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 0
   [junit4]   2> 683059 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
   [junit4]   2> 683060 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 0
   [junit4]   2> 683062 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 0
   [junit4]   2> 683064 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 0
   [junit4]   2> 683065 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 0
   [junit4]   2> 683067 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 0
   [junit4]   2> 683069 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 0
   [junit4]   2> 683070 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
   [junit4]   2> 683072 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 0
   [junit4]   2> 683074 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 1
   [junit4]   2> 683075 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
   [junit4]   2> 683077 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 0
   [junit4]   2> 683078 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 0
   [junit4]   2> 683080 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
   [junit4]   2> 683082 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
   [junit4]   2> 683083 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
   [junit4]   2> 683085 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
   [junit4]   2> 683086 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 0
   [junit4]   2> 683088 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 0
   [junit4]   2> 683090 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
   [junit4]   2> 683091 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 0
   [junit4]   2> 683093 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 0
   [junit4]   2> 683095 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 1
   [junit4]   2> 683096 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 0
   [junit4]   2> 683098 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 0
   [junit4]   2> 683099 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 0
   [junit4]   2> 683101 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 0
   [junit4]   2> 683103 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 1
   [junit4]   2> 683104 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 0
   [junit4]   2> 683106 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
   [junit4]   2> 683107 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 0
   [junit4]   2> 683109 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
   [junit4]   2> 683111 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 0
   [junit4]   2> 683112 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 0
   [junit4]   2> 683114 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 0
   [junit4]   2> 683116 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 1
   [junit4]   2> 683117 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 0
   [junit4]   2> 683119 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 0
   [junit4]   2> 683120 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
   [junit4]   2> 683122 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 0
   [junit4]   2> 683124 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 0
   [junit4]   2> 683125 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 0
   [junit4]   2> 683127 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 0
   [junit4]   2> 683128 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 0
   [junit4]   2> 683130 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 0
   [junit4]   2> 683132 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 1
   [junit4]   2> 683133 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 0
   [junit4]   2> 683135 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
   [junit4]   2> 683136 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 0
   [junit4]   2> 683138 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 0
   [junit4]   2> 683140 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 0
   [junit4]   2> 683141 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 0
   [junit4]   2> 683143 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 0
   [junit4]   2> 683145 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 1
   [junit4]   2> 683146 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 0
   [junit4]   2> 683148 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 0
   [junit4]   2> 683150 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 1
   [junit4]   2> 683151 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 0
   [junit4]   2> 683153 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 0
   [junit4]   2> 683155 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 1
   [junit4]   2> 683156 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[66]} 0 0
   [junit4]   2> 683158 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[67]} 0 0
   [junit4]   2> 683159 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[68]} 0 0
   [junit4]   2> 683161 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[69]} 0 0
   [junit4]   2> 683163 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[70]} 0 0
   [junit4]   2> 683164 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[71]} 0 0
   [junit4]   2> 683166 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[72]} 0 0
   [junit4]   2> 683168 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[73]} 0 0
   [junit4]   2> 683169 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[74]} 0 0
   [junit4]   2> 683171 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[75]} 0 0
   [junit4]   2> 683173 T2189 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[76]} 0 1
   [junit4]   2> 683174 T2190 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[77]} 0 0
   [junit4]   2> 683176 T2191 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[78]} 0 0
   [junit4]   2> 683177 T2188 C1712 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[79]} 0 0
   [junit4]   2> 683179 T2189 C1712 oasup.LogUpdateProcessor.finish [collec

[...truncated too long message...]

nit4]   2> 742053 T2830 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b2a1a5 main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):c1 _1(5.0):c1)}
   [junit4]   2> 742053 T2820 C1790 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 4
   [junit4]   2> 742056 T2822 C1790 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=id:2001&wt=javabin&version=2} hits=1 status=0 QTime=1 
   [junit4]   2> 742056 T2138 oas.SolrTestCaseJ4.tearDown ###Ending doTestIndexAndConfigAliasReplication
   [junit4]   2> 742077 T2138 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=7307567
   [junit4]   2> 742078 T2138 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1d4b9a5
   [junit4]   2> 742078 T2138 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 742079 T2138 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 742079 T2138 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 742079 T2138 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 742080 T2138 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 742080 T2138 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 742081 T2138 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402587/master/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402587/master/collection1/data;done=false>>]
   [junit4]   2> 742081 T2138 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402587/master/collection1/data
   [junit4]   2> 742081 T2138 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402587/master/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402587/master/collection1/data/index;done=false>>]
   [junit4]   2> 742082 T2138 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402587/master/collection1/data/index
   [junit4]   2> 742082 T2138 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 742154 T2138 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=2506735
   [junit4]   2> 742155 T2138 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@e4fb8e
   [junit4]   2> 742155 T2138 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 742156 T2138 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 742156 T2138 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 742156 T2138 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 742157 T2138 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 742158 T2138 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 742158 T2138 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402693/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402693/slave/collection1/data;done=false>>]
   [junit4]   2> 742159 T2138 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402693/slave/collection1/data
   [junit4]   2> 742159 T2138 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402693/slave/collection1/data/index.20130816074005006 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402693/slave/collection1/data/index.20130816074005006;done=false>>]
   [junit4]   2> 742160 T2138 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1376624402693/slave/collection1/data/index.20130816074005006
   [junit4]   2> 742160 T2138 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 742218 T2138 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=242), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=242)), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=th_TH, timezone=Europe/Volgograd
   [junit4]   2> NOTE: Linux 3.2.0-51-generic i386/Oracle Corporation 1.8.0-ea (32-bit)/cpus=8,threads=1,free=44920768,total=174788608
   [junit4]   2> NOTE: All tests run in this JVM: [TestQueryTypes, CurrencyFieldXmlFileTest, TestCopyFieldCollectionResource, ShardRoutingCustomTest, TestComponentsName, TestSolrJ, TestCSVResponseWriter, TestNumberUtils, DirectSolrSpellCheckerTest, TestReloadAndDeleteDocs, TestFastLRUCache, PrimUtilsTest, TestFastOutputStream, TestIndexSearcher, TestJmxIntegration, RequestHandlersTest, BadIndexSchemaTest, SortByFunctionTest, SuggesterTSTTest, TestSolr4Spatial, TestAddFieldRealTimeGet, TestOmitPositions, TestMultiCoreConfBootstrap, ZkSolrClientTest, TestUtils, TestFiltering, TestQuerySenderListener, MinimalSchemaTest, ChaosMonkeySafeLeaderTest, SolrPluginUtilsTest, LeaderElectionIntegrationTest, OpenExchangeRatesOrgProviderTest, DistanceFunctionTest, TestSchemaNameResource, SolrIndexConfigTest, TestFuzzyAnalyzedSuggestions, HdfsLockFactoryTest, TestBinaryField, PreAnalyzedFieldTest, InfoHandlerTest, NotRequiredUniqueKeyTest, IndexSchemaRuntimeFieldTest, TestClassNameShortening, MultiTermTest, TestAnalyzedSuggestions, SpellCheckComponentTest, TestHashPartitioner, TestAtomicUpdateErrorCases, TestInfoStreamLogging, RAMDirectoryFactoryTest, TestXIncludeConfig, DateFieldTest, SolrCoreCheckLockOnStartupTest, TestSchemaSimilarityResource, HdfsUnloadDistributedZkTest, TestSchemaResource, BlockCacheTest, HdfsBasicDistributedZk2Test, CurrencyFieldOpenExchangeTest, TestManagedSchema, TestReload, PathHierarchyTokenizerFactoryTest, FieldAnalysisRequestHandlerTest, TestLazyCores, TestSolrDeletionPolicy2, PingRequestHandlerTest, TestManagedSchemaFieldResource, HdfsDirectoryTest, JSONWriterTest, HighlighterConfigTest, TestSolrCoreProperties, TestDistributedGrouping, UniqFieldsUpdateProcessorFactoryTest, TestCodecSupport, RequiredFieldsTest, DirectUpdateHandlerTest, TestRangeQuery, BasicDistributedZkTest, ShardRoutingTest, RecoveryZkTest, TestReplicationHandler]
   [junit4] Completed on J1 in 60.00s, 14 tests, 1 failure <<< FAILURES!

[...truncated 462 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:389: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:369: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:450: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1230: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:873: There were test failures: 320 suites, 1361 tests, 1 failure, 38 ignored (6 assumptions)

Total time: 37 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-ea-b102 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure