You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/07/19 17:36:27 UTC

[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b98) - Build # 6637 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6637/
Java: 64bit/jdk1.8.0-ea-b98 -XX:+UseCompressedOops -XX:+UseParallelGC

1 tests failed.
REGRESSION:  org.apache.solr.handler.TestReplicationHandler.doTestStressReplication

Error Message:
timed out waiting for collection1 startAt time to exceed: Fri Jul 19 11:23:16 EDT 2013

Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Fri Jul 19 11:23:16 EDT 2013
	at __randomizedtesting.SeedInfo.seed([ACC91CDAB6BEA035:77621C1CB396C986]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1507)
	at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:811)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:491)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:724)




Build Log:
[...truncated 9511 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4]   2> 208774 T1085 oas.SolrTestCaseJ4.setUp ###Starting doTestDetails
   [junit4]   2> 208777 T1085 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 208779 T1085 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:๔๑๓๖๑
   [junit4]   2> 208781 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 208781 T1085 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 208782 T1085 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master
   [junit4]   2> 208782 T1085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/'
   [junit4]   2> 208792 T1085 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/solr.xml
   [junit4]   2> 208793 T1085 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/solr.xml does not exist, using default configuration
   [junit4]   2> 208798 T1085 oasc.CoreContainer.<init> New CoreContainer 1559715686
   [junit4]   2> 208798 T1085 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/]
   [junit4]   2> 208799 T1085 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 208799 T1085 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 208799 T1085 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 208799 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 208800 T1085 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 208800 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 208800 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 208800 T1085 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 208800 T1085 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 208801 T1085 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 208804 T1085 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 208806 T1095 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1
   [junit4]   2> 208807 T1095 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/'
   [junit4]   2> 208817 T1095 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 208821 T1095 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 208822 T1095 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 208824 T1095 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 208826 T1095 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 208826 T1095 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 208826 T1095 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data/
   [junit4]   2> 208826 T1095 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 208827 T1095 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data
   [junit4]   2> 208827 T1095 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data/index/
   [junit4]   2> 208827 T1095 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 208828 T1095 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data/index
   [junit4]   2> 208829 T1095 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@146d2329 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52b79d72),segFN=segments_1,generation=1}
   [junit4]   2> 208829 T1095 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 208830 T1095 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 208830 T1095 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 208830 T1095 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 208830 T1095 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 208830 T1095 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 208831 T1095 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 208832 T1095 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 208833 T1095 oass.SolrIndexSearcher.<init> Opening Searcher@46288e25 main
   [junit4]   2> 208833 T1095 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 208833 T1095 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 208833 T1095 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 208833 T1095 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 208834 T1096 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@46288e25 main{StandardDirectoryReader(segments_1:1)}
   [junit4]   2> 208834 T1095 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 208835 T1085 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 208835 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 208835 T1085 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 208841 T1085 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 208842 T1085 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:๕๐๐๗๙
   [junit4]   2> 208843 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 208843 T1085 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 208843 T1085 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave
   [junit4]   2> 208844 T1085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/'
   [junit4]   2> 208855 T1085 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/solr.xml
   [junit4]   2> 208855 T1085 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/solr.xml does not exist, using default configuration
   [junit4]   2> 208861 T1085 oasc.CoreContainer.<init> New CoreContainer 296380328
   [junit4]   2> 208861 T1085 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/]
   [junit4]   2> 208862 T1085 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 208862 T1085 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 208862 T1085 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 208862 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 208863 T1085 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 208863 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 208863 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 208863 T1085 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 208864 T1085 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 208864 T1085 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 208868 T1085 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 208870 T1107 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1
   [junit4]   2> 208870 T1107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/'
   [junit4]   2> 208882 T1107 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 208886 T1107 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 208886 T1107 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 208889 T1107 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 208891 T1107 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 208891 T1107 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 208891 T1107 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/
   [junit4]   2> 208891 T1107 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 208892 T1107 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data
   [junit4]   2> 208892 T1107 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index/
   [junit4]   2> 208892 T1107 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 208893 T1107 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index
   [junit4]   2> 208893 T1107 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6dcf04ae lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@53a6e8b0),segFN=segments_1,generation=1}
   [junit4]   2> 208894 T1107 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 208894 T1107 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 208895 T1107 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 208895 T1107 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 208895 T1107 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 208895 T1107 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 208895 T1107 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 208896 T1107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 208897 T1107 oass.SolrIndexSearcher.<init> Opening Searcher@49c49e3f main
   [junit4]   2> 208897 T1107 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 208897 T1107 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 208897 T1107 oascsi.HttpClientUtil.createClient Creating new http client, config:connTimeout=5000&socketTimeout=20000&allowCompression=false&maxConnections=10000&maxConnectionsPerHost=10000
   [junit4]   2> 208905 T1107 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
   [junit4]   2> 208905 T1108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49c49e3f main{StandardDirectoryReader(segments_1:1)}
   [junit4]   2> 208905 T1107 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 208906 T1085 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 208906 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 208907 T1085 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> ASYNC  NEW_CORE C344 name=collection1 org.apache.solr.core.SolrCore@12aa5b76
   [junit4]   2> 208913 T1091 C344 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=1 
   [junit4]   2> 208917 T1092 C344 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
   [junit4]   2> ASYNC  NEW_CORE C345 name=collection1 org.apache.solr.core.SolrCore@12aa5b76
   [junit4]   2> 208930 T1093 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=1 
   [junit4]   2> ASYNC  NEW_CORE C346 name=collection1 org.apache.solr.core.SolrCore@1ebe02a7
   [junit4]   2> 208931 T1103 C346 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=11 
   [junit4]   2> 208936 T1094 C345 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@146d2329 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52b79d72),segFN=segments_1,generation=1}
   [junit4]   2> 208937 T1094 C345 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 208938 T1094 C345 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 3
   [junit4]   2> 208941 T1091 C345 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 208942 T1091 C345 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@146d2329 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52b79d72),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@146d2329 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52b79d72),segFN=segments_2,generation=2}
   [junit4]   2> 208943 T1091 C345 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 208943 T1091 C345 oass.SolrIndexSearcher.<init> Opening Searcher@18c3596a main
   [junit4]   2> 208944 T1091 C345 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 208944 T1096 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@18c3596a main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C1)}
   [junit4]   2> 208944 T1091 C345 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 3
   [junit4]   2> 208947 T1111 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 208948 T1111 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 208951 T1092 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
   [junit4]   2> 208951 T1111 oash.SnapPuller.fetchLatestIndex Master's generation: 2
   [junit4]   2> 208951 T1111 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
   [junit4]   2> 208952 T1111 oash.SnapPuller.fetchLatestIndex Starting replication process
   [junit4]   2> 208956 T1093 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2 
   [junit4]   2> 208958 T1111 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 10
   [junit4]   2> 208959 T1111 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243367
   [junit4]   2> 208959 T1111 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@4b6fd0a4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ecd7e9a) fullCopy=false
   [junit4]   2> 208965 T1094 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=2 
   [junit4]   2> 208971 T1091 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 208975 T1092 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 208978 T1093 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 208982 T1094 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1 
   [junit4]   2> 208985 T1091 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 208988 T1092 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 208991 T1093 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 208994 T1094 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 208997 T1091 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fdt&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
   [junit4]   2> 208999 T1111 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
   [junit4]   2> 209000 T1111 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
   [junit4]   2> 209000 T1111 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 209001 T1111 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
   [junit4]   2> 209006 T1111 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6dcf04ae lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@53a6e8b0),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6dcf04ae lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@53a6e8b0),segFN=segments_2,generation=2}
   [junit4]   2> 209007 T1111 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 209007 T1111 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 209010 T1111 oass.SolrIndexSearcher.<init> Opening Searcher@7339b73e main
   [junit4]   2> 209010 T1108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7339b73e main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C1)}
   [junit4]   2> 209011 T1111 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243367 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243367;done=true>>]
   [junit4]   2> 209011 T1111 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243367
   [junit4]   2> 209011 T1105 C346 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:41361/solr/replication&command=fetchindex&wait=true} status=0 QTime=64 
   [junit4]   2> 209017 T1092 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
   [junit4]   2> 209018 T1106 C346 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=4 
   [junit4]   2> 209022 T1093 C345 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 1
   [junit4]   2> 209025 T1094 C345 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 209028 T1094 C345 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@146d2329 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52b79d72),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@146d2329 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52b79d72),segFN=segments_3,generation=3}
   [junit4]   2> 209029 T1094 C345 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 209030 T1094 C345 oass.SolrIndexSearcher.<init> Opening Searcher@1305c717 main
   [junit4]   2> 209030 T1096 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1305c717 main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):C1 _1(5.0):C1)}
   [junit4]   2> 209030 T1094 C345 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 209031 T1094 C345 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 6
   [junit4]   2> 209033 T1113 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 209033 T1113 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 209035 T1091 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
   [junit4]   2> 209036 T1113 oash.SnapPuller.fetchLatestIndex Master's generation: 3
   [junit4]   2> 209036 T1113 oash.SnapPuller.fetchLatestIndex Slave's generation: 2
   [junit4]   2> 209036 T1113 oash.SnapPuller.fetchLatestIndex Starting replication process
   [junit4]   2> 209039 T1092 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1 
   [junit4]   2> 209040 T1113 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 19
   [junit4]   2> 209040 T1113 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243449
   [junit4]   2> 209040 T1113 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3da17908 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7bf52395) fullCopy=false
   [junit4]   2> 209043 T1093 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 209047 T1094 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 209048 T1113 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fnm because it already exists
   [junit4]   2> 209050 T1091 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 209051 T1113 oash.SnapPuller.downloadIndexFiles Skipping download for _0.nvm because it already exists
   [junit4]   2> 209053 T1092 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 209056 T1093 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 209060 T1094 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.fdt&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=1 
   [junit4]   2> 209063 T1091 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 209064 T1113 oash.SnapPuller.downloadIndexFiles Skipping download for _0.tim because it already exists
   [junit4]   2> 209064 T1113 oash.SnapPuller.downloadIndexFiles Skipping download for _0.nvd because it already exists
   [junit4]   2> 209064 T1113 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fdx because it already exists
   [junit4]   2> 209064 T1113 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
   [junit4]   2> 209064 T1113 oash.SnapPuller.downloadIndexFiles Skipping download for _0.doc because it already exists
   [junit4]   2> 209065 T1113 oash.SnapPuller.downloadIndexFiles Skipping download for _0.tip because it already exists
   [junit4]   2> 209067 T1092 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 209068 T1113 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fdt because it already exists
   [junit4]   2> 209071 T1093 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 209074 T1094 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
   [junit4]   2> 209075 T1113 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
   [junit4]   2> 209076 T1113 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
   [junit4]   2> 209076 T1113 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 209076 T1113 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
   [junit4]   2> 209077 T1113 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
   [junit4]   2> 209078 T1113 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6dcf04ae lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@53a6e8b0),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6dcf04ae lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@53a6e8b0),segFN=segments_3,generation=3}
   [junit4]   2> 209078 T1113 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 209078 T1113 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 209079 T1113 oass.SolrIndexSearcher.<init> Opening Searcher@7aecec0c main
   [junit4]   2> 209079 T1108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7aecec0c main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):C1 _1(5.0):C1)}
   [junit4]   2> 209079 T1113 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243449 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243449;done=true>>]
   [junit4]   2> 209079 T1113 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243449
   [junit4]   2> 209080 T1104 C346 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:41361/solr/replication&command=fetchindex&wait=true} status=0 QTime=48 
   [junit4]   2> 209085 T1091 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
   [junit4]   2> 209086 T1103 C346 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=4 
   [junit4]   2> 209090 T1092 C345 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 1
   [junit4]   2> 209092 T1093 C345 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 209094 T1093 C345 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@146d2329 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52b79d72),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@146d2329 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52b79d72),segFN=segments_3,generation=3}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@146d2329 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@52b79d72),segFN=segments_4,generation=4}
   [junit4]   2> 209094 T1093 C345 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
   [junit4]   2> 209095 T1093 C345 oass.SolrIndexSearcher.<init> Opening Searcher@2c52d87f main
   [junit4]   2> 209095 T1093 C345 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 209095 T1096 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c52d87f main{StandardDirectoryReader(segments_4:7:nrt _0(5.0):C1 _1(5.0):C1 _2(5.0):C1)}
   [junit4]   2> 209095 T1093 C345 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 3
   [junit4]   2> 209097 T1115 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 209097 T1115 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 209100 T1094 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
   [junit4]   2> 209100 T1115 oash.SnapPuller.fetchLatestIndex Master's generation: 4
   [junit4]   2> 209100 T1115 oash.SnapPuller.fetchLatestIndex Slave's generation: 3
   [junit4]   2> 209100 T1115 oash.SnapPuller.fetchLatestIndex Starting replication process
   [junit4]   2> 209103 T1091 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1 
   [junit4]   2> 209104 T1115 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 28
   [junit4]   2> 209105 T1115 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243513
   [junit4]   2> 209105 T1115 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@d99351b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@39576b6f) fullCopy=false
   [junit4]   2> 209108 T1092 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 209109 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _1.doc because it already exists
   [junit4]   2> 209109 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _1.fnm because it already exists
   [junit4]   2> 209112 T1093 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 209115 T1094 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 209116 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _0.nvd because it already exists
   [junit4]   2> 209116 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
   [junit4]   2> 209116 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _1.tip because it already exists
   [junit4]   2> 209117 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _0.doc because it already exists
   [junit4]   2> 209117 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _1.tim because it already exists
   [junit4]   2> 209117 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _1.nvm because it already exists
   [junit4]   2> 209117 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fnm because it already exists
   [junit4]   2> 209117 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _1.nvd because it already exists
   [junit4]   2> 209119 T1091 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.fdt&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 209120 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _0.nvm because it already exists
   [junit4]   2> 209123 T1092 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 209127 T1093 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=1 
   [junit4]   2> 209130 T1094 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 209131 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _1.fdx because it already exists
   [junit4]   2> 209134 T1091 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=1 
   [junit4]   2> 209134 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _1.fdt because it already exists
   [junit4]   2> 209135 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _1.si because it already exists
   [junit4]   2> 209137 T1092 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 209138 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _0.tim because it already exists
   [junit4]   2> 209138 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fdx because it already exists
   [junit4]   2> 209138 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _0.tip because it already exists
   [junit4]   2> 209138 T1115 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fdt because it already exists
   [junit4]   2> 209141 T1093 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
   [junit4]   2> 209142 T1115 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
   [junit4]   2> 209142 T1115 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
   [junit4]   2> 209142 T1115 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 209142 T1115 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
   [junit4]   2> 209143 T1115 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
   [junit4]   2> 209145 T1115 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6dcf04ae lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@53a6e8b0),segFN=segments_3,generation=3}
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6dcf04ae lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@53a6e8b0),segFN=segments_4,generation=4}
   [junit4]   2> 209145 T1115 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
   [junit4]   2> 209145 T1115 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 209146 T1115 oass.SolrIndexSearcher.<init> Opening Searcher@42e09500 main
   [junit4]   2> 209146 T1108 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@42e09500 main{StandardDirectoryReader(segments_4:7:nrt _0(5.0):C1 _1(5.0):C1 _2(5.0):C1)}
   [junit4]   2> 209147 T1115 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243513 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243513;done=true>>]
   [junit4]   2> 209147 T1115 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index.20130719112243513
   [junit4]   2> 209147 T1105 C346 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:41361/solr/replication&command=fetchindex&wait=true} status=0 QTime=50 
   [junit4]   2> 209150 T1085 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 209153 T1085 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:๔๘๐๐๐
   [junit4]   2> 209153 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 209154 T1085 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 209154 T1085 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater
   [junit4]   2> 209154 T1085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/'
   [junit4]   2> 209162 T1085 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/solr.xml
   [junit4]   2> 209163 T1085 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/solr.xml does not exist, using default configuration
   [junit4]   2> 209168 T1085 oasc.CoreContainer.<init> New CoreContainer 1643252966
   [junit4]   2> 209168 T1085 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/]
   [junit4]   2> 209169 T1085 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 209169 T1085 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 209169 T1085 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 209169 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 209169 T1085 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 209170 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 209170 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 209170 T1085 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 209170 T1085 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 209171 T1085 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 209174 T1085 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 209176 T1126 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1
   [junit4]   2> 209176 T1126 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/'
   [junit4]   2> 209191 T1126 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 209197 T1126 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 209197 T1126 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 209200 T1126 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 209202 T1126 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 209202 T1126 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 209202 T1126 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data/
   [junit4]   2> 209203 T1126 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 209203 T1126 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data
   [junit4]   2> 209203 T1126 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data/index/
   [junit4]   2> 209203 T1126 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 209204 T1126 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data/index
   [junit4]   2> 209204 T1126 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6e647f2d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3cd35a71),segFN=segments_1,generation=1}
   [junit4]   2> 209205 T1126 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 209205 T1126 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 209206 T1126 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 209206 T1126 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 209206 T1126 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 209206 T1126 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 209206 T1126 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 209207 T1126 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 209208 T1126 oass.SolrIndexSearcher.<init> Opening Searcher@1632810a main
   [junit4]   2> 209208 T1126 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 209208 T1126 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 209209 T1126 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 209209 T1126 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 209209 T1126 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml
   [junit4]   2> 209209 T1126 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 209209 T1127 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1632810a main{StandardDirectoryReader(segments_1:1)}
   [junit4]   2> 209209 T1126 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 209210 T1085 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 209211 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 209211 T1085 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 209220 T1094 C345 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0 
   [junit4]   2> ASYNC  NEW_CORE C347 name=collection1 org.apache.solr.core.SolrCore@22f8d02
   [junit4]   2> 209222 T1123 C347 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=4 
   [junit4]   2> 209245 T1085 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1643252966
   [junit4]   2> 209245 T1085 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@22f8d02
   [junit4]   2> 209246 T1085 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 209246 T1085 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 209246 T1085 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 209247 T1085 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 209247 T1085 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 209247 T1085 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 209248 T1085 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data/index;done=false>>]
   [junit4]   2> 209248 T1085 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data/index
   [junit4]   2> 209248 T1085 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data;done=false>>]
   [junit4]   2> 209248 T1085 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363557/repeater/collection1/data
   [junit4]   2> 209249 T1085 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 209301 T1085 oas.SolrTestCaseJ4.tearDown ###Ending doTestDetails
   [junit4]   2> 209323 T1085 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1559715686
   [junit4]   2> 209324 T1085 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@12aa5b76
   [junit4]   2> 209324 T1085 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 209324 T1085 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 209325 T1085 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 209325 T1085 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 209325 T1085 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 209326 T1085 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 209326 T1085 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data;done=false>>]
   [junit4]   2> 209326 T1085 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data
   [junit4]   2> 209327 T1085 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data/index;done=false>>]
   [junit4]   2> 209327 T1085 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363184/master/collection1/data/index
   [junit4]   2> 209328 T1085 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 209403 T1085 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=296380328
   [junit4]   2> 209404 T1085 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1ebe02a7
   [junit4]   2> 209405 T1085 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 209405 T1085 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 209406 T1085 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 209406 T1085 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 209408 T1085 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 209408 T1085 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 209409 T1085 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data;done=false>>]
   [junit4]   2> 209409 T1085 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data
   [junit4]   2> 209410 T1085 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index;done=false>>]
   [junit4]   2> 209410 T1085 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363247/slave/collection1/data/index
   [junit4]   2> 209411 T1085 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 209468 T1085 oas.SolrTestCaseJ4.setUp ###Starting doTestIndexAndConfigReplication
   [junit4]   2> 209470 T1085 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 209472 T1085 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:๔๘๒๙๙
   [junit4]   2> 209473 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 209473 T1085 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 209473 T1085 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master
   [junit4]   2> 209474 T1085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/'
   [junit4]   2> 209483 T1085 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/solr.xml
   [junit4]   2> 209483 T1085 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/solr.xml does not exist, using default configuration
   [junit4]   2> 209488 T1085 oasc.CoreContainer.<init> New CoreContainer 795256136
   [junit4]   2> 209489 T1085 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/]
   [junit4]   2> 209489 T1085 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 209489 T1085 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 209489 T1085 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 209489 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 209490 T1085 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 209490 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 209490 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 209490 T1085 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 209490 T1085 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 209491 T1085 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 209494 T1085 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 209496 T1138 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/collection1
   [junit4]   2> 209497 T1138 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/collection1/'
   [junit4]   2> 209517 T1138 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 209521 T1138 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 209521 T1138 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 209523 T1138 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 209526 T1138 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 209526 T1138 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 209526 T1138 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/collection1/data/
   [junit4]   2> 209526 T1138 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 209527 T1138 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/collection1/data
   [junit4]   2> 209527 T1138 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/collection1/data/index/
   [junit4]   2> 209527 T1138 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 209528 T1138 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363877/master/collection1/data/index
   [junit4]   2> 209528 T1138 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3e2fa9ee lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@fa6973f),segFN=segments_1,generation=1}
   [junit4]   2> 209529 T1138 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 209529 T1138 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 209529 T1138 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 209530 T1138 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 209530 T1138 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 209530 T1138 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 209530 T1138 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 209532 T1138 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 209532 T1138 oass.SolrIndexSearcher.<init> Opening Searcher@4af70f3c main
   [junit4]   2> 209533 T1138 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 209533 T1138 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 209533 T1138 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 209533 T1138 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 209533 T1138 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 209534 T1139 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4af70f3c main{StandardDirectoryReader(segments_1:1)}
   [junit4]   2> 209534 T1085 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 209534 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 209535 T1085 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> 209540 T1085 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 209542 T1085 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:๓๓๔๙๙
   [junit4]   2> 209542 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 209542 T1085 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 209543 T1085 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave
   [junit4]   2> 209543 T1085 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/'
   [junit4]   2> 209552 T1085 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/solr.xml
   [junit4]   2> 209552 T1085 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/solr.xml does not exist, using default configuration
   [junit4]   2> 209558 T1085 oasc.CoreContainer.<init> New CoreContainer 1298010035
   [junit4]   2> 209558 T1085 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/]
   [junit4]   2> 209559 T1085 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 209559 T1085 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 209559 T1085 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 209559 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 209559 T1085 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 209560 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 209560 T1085 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 209560 T1085 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 209560 T1085 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 209561 T1085 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 209564 T1085 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 209566 T1150 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/collection1
   [junit4]   2> 209566 T1150 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/collection1/'
   [junit4]   2> 209579 T1150 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 209584 T1150 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 209584 T1150 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 209587 T1150 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 209589 T1150 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 209589 T1150 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 209589 T1150 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/collection1/data/
   [junit4]   2> 209589 T1150 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 209590 T1150 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/collection1/data
   [junit4]   2> 209590 T1150 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/collection1/data/index/
   [junit4]   2> 209590 T1150 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 209591 T1150 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247363946/slave/collection1/data/index
   [junit4]   2> 209592 T1150 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7fc72ff8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@76e07b63),segFN=segments_1,generation=1}
   [junit4]   2> 209592 T1150 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 209593 T1150 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 209593 T1150 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 209593 T1150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 209593 T1150 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 209593 T1150 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 209594 T1150 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 209595 T1150 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 209595 T1150 oass.SolrIndexSearcher.<init> Opening Searcher@67ee0283 main
   [junit4]   2> 209596 T1150 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 209596 T1150 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 209596 T1150 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
   [junit4]   2> 209596 T1151 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@67ee0283 main{StandardDirectoryReader(segments_1:1)}
   [junit4]   2> 209596 T1150 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 209597 T1085 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 209597 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 209598 T1085 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
   [junit4]   2> ASYNC  NEW_CORE C348 name=collection1 org.apache.solr.core.SolrCore@76ef6836
   [junit4]   2> 209603 T1134 C348 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 209607 T1135 C348 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3e2fa9ee lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@fa6973f),segFN=segments_1,generation=1}
   [junit4]   2> 209608 T1135 C348 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 209609 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 2
   [junit4]   2> 209612 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 1
   [junit4]   2> 209615 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 1
   [junit4]   2> 209617 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
   [junit4]   2> 209620 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
   [junit4]   2> 209624 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 1
   [junit4]   2> 209626 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
   [junit4]   2> 209629 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 1
   [junit4]   2> 209632 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 1
   [junit4]   2> 209635 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 1
   [junit4]   2> 209638 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 0
   [junit4]   2> 209641 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 0
   [junit4]   2> 209644 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 0
   [junit4]   2> 209647 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
   [junit4]   2> 209650 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 0
   [junit4]   2> 209653 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 0
   [junit4]   2> 209656 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 1
   [junit4]   2> 209658 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 0
   [junit4]   2> 209661 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 1
   [junit4]   2> 209663 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
   [junit4]   2> 209666 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
   [junit4]   2> 209669 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
   [junit4]   2> 209672 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
   [junit4]   2> 209676 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 1
   [junit4]   2> 209679 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 1
   [junit4]   2> 209681 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
   [junit4]   2> 209684 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 0
   [junit4]   2> 209687 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 0
   [junit4]   2> 209691 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 1
   [junit4]   2> 209695 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 0
   [junit4]   2> 209700 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 1
   [junit4]   2> 209704 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 1
   [junit4]   2> 209708 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 1
   [junit4]   2> 209711 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 0
   [junit4]   2> 209714 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 0
   [junit4]   2> 209716 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
   [junit4]   2> 209719 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 1
   [junit4]   2> 209721 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
   [junit4]   2> 209724 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 0
   [junit4]   2> 209726 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 0
   [junit4]   2> 209729 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 0
   [junit4]   2> 209732 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 0
   [junit4]   2> 209735 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 1
   [junit4]   2> 209737 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 0
   [junit4]   2> 209740 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 1
   [junit4]   2> 209743 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 1
   [junit4]   2> 209746 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 1
   [junit4]   2> 209749 T1134 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 1
   [junit4]   2> 209752 T1135 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 1
   [junit4]   2> 209755 T1136 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 1
   [junit4]   2> 209758 T1137 C348 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {ad

[...truncated too long message...]

CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 274995 T1778 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
   [junit4]   2> 274995 T1779 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@26abbe53 main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
   [junit4]   2> 274995 T1778 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 274996 T1085 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 274996 T1085 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 274999 T1782 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 274999 T1782 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> ASYNC  NEW_CORE C406 name=collection1 org.apache.solr.core.SolrCore@54d70769
   [junit4]   2> 275001 T1762 C406 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
   [junit4]   2> ASYNC  NEW_CORE C407 name=collection1 org.apache.solr.core.SolrCore@2a3b7550
   [junit4]   2> 275002 T1772 C407 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:60699/solr/replication&command=fetchindex&wait=true} status=0 QTime=4 
   [junit4]   2> 275003 T1085 oas.SolrTestCaseJ4.tearDown ###Ending testNoWriter
   [junit4]   2> 275024 T1085 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1511441961
   [junit4]   2> 275024 T1085 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@54d70769
   [junit4]   2> 275025 T1085 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 275025 T1085 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 275025 T1085 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 275025 T1085 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 275026 T1085 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 275027 T1085 oasc.CachingDirectoryFactory.close Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 275027 T1085 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428528/master/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428528/master/collection1/data;done=false>>]
   [junit4]   2> 275027 T1085 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428528/master/collection1/data
   [junit4]   2> 275027 T1085 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428528/master/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428528/master/collection1/data/index;done=false>>]
   [junit4]   2> 275028 T1085 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428528/master/collection1/data/index
   [junit4]   2> 275028 T1085 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 275100 T1085 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=639820694
   [junit4]   2> 275100 T1085 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2a3b7550
   [junit4]   2> 275101 T1085 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 275101 T1085 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 275101 T1085 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 275102 T1085 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 275102 T1085 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 275103 T1085 oasc.CachingDirectoryFactory.close Closing NRTCachingDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 275104 T1085 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428588/slave/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428588/slave/collection1/data/index;done=false>>]
   [junit4]   2> 275104 T1085 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428588/slave/collection1/data/index
   [junit4]   2> 275104 T1085 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428588/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428588/slave/collection1/data;done=false>>]
   [junit4]   2> 275105 T1085 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.handler.TestReplicationHandler$SolrInstance-1374247428588/slave/collection1/data
   [junit4]   2> 275105 T1085 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 275165 T1085 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=th_TH_TH_#u-nu-thai, timezone=America/Kentucky/Louisville
   [junit4]   2> NOTE: Linux 3.2.0-49-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=51579848,total=378535936
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrQueryParserDefaultOperatorResource, SliceStateTest, ShowFileRequestHandlerTest, TestDefaultSearchFieldResource, TestExtendedDismaxParser, TestFuzzyAnalyzedSuggestions, LukeRequestHandlerTest, FileBasedSpellCheckerTest, TestFastWriter, TestRemoteStreaming, TestBadConfig, PreAnalyzedFieldTest, ExternalFileFieldSortTest, AddSchemaFieldsUpdateProcessorFactoryTest, SolrTestCaseJ4Test, TestFastLRUCache, PreAnalyzedUpdateProcessorTest, SOLR749Test, DocValuesTest, TestQueryUtils, TestReversedWildcardFilterFactory, TestSerializedLuceneMatchVersion, CacheHeaderTest, TestCharFilters, TestJoin, DirectUpdateHandlerOptimizeTest, BadCopyFieldTest, TestSweetSpotSimilarityFactory, WordBreakSolrSpellCheckerTest, PrimitiveFieldTypeTest, ResourceLoaderTest, TestConfig, TestSolrDeletionPolicy2, AutoCommitTest, TestRandomDVFaceting, TestMaxScoreQueryParser, OverseerTest, TestGroupingSearch, TestSolrDeletionPolicy1, FieldMutatingUpdateProcessorTest, CoreAdminHandlerTest, LoggingHandlerTest, TestIBSimilarityFactory, TestSolrXmlPersistence, InfoHandlerTest, TestFieldTypeResource, PrimUtilsTest, BasicFunctionalityTest, TestReplicationHandler]
   [junit4] Completed on J0 in 66.42s, 14 tests, 1 failure <<< FAILURES!

[...truncated 758 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:389: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:369: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1247: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:890: There were test failures: 318 suites, 1342 tests, 1 failure, 37 ignored (6 assumptions)

Total time: 36 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-ea-b98 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure