You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/08/05 05:14:00 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0-ea-b99) - Build #
6880 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6880/
Java: 64bit/jdk1.8.0-ea-b99 -XX:+UseCompressedOops -XX:+UseSerialGC
1 tests failed.
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestStressReplication
Error Message:
timed out waiting for collection1 startAt time to exceed: Mon Aug 05 07:09:26 AMT 2013
Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Mon Aug 05 07:09:26 AMT 2013
at __randomizedtesting.SeedInfo.seed([59D4DAA29E2F1A71:827FDA649B0773C2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1507)
at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:811)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:491)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Build Log:
[...truncated 9830 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> 737393 T2223 oas.SolrTestCaseJ4.setUp ###Starting testEmptyCommits
[junit4] 2> 737397 T2223 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 737399 T2223 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58207
[junit4] 2> 737400 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 737400 T2223 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 737400 T2223 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master
[junit4] 2> 737401 T2223 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/'
[junit4] 2> 737415 T2223 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/solr.xml
[junit4] 2> 737416 T2223 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/solr.xml does not exist, using default configuration
[junit4] 2> 737425 T2223 oasc.CoreContainer.<init> New CoreContainer 142637947
[junit4] 2> 737425 T2223 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/]
[junit4] 2> 737426 T2223 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 737426 T2223 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 737426 T2223 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 737436 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 737436 T2223 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 737437 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 737437 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 737437 T2223 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 737438 T2223 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 737438 T2223 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4] 2> 737445 T2233 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1
[junit4] 2> 737445 T2233 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/'
[junit4] 2> 737458 T2233 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 737464 T2233 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 737464 T2233 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 737466 T2233 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 737469 T2233 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 737469 T2233 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 737469 T2233 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data/
[junit4] 2> 737469 T2233 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 737470 T2233 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data
[junit4] 2> 737470 T2233 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data/index/
[junit4] 2> 737470 T2233 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 737470 T2233 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data/index
[junit4] 2> 737471 T2233 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_1,generation=1}
[junit4] 2> 737472 T2233 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 737472 T2233 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 737473 T2233 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 737473 T2233 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 737473 T2233 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 737473 T2233 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 737473 T2233 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 737475 T2233 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 737476 T2233 oass.SolrIndexSearcher.<init> Opening Searcher@48888d2f main
[junit4] 2> 737476 T2233 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 737476 T2233 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 737476 T2233 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 737476 T2233 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 737477 T2234 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48888d2f main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 737477 T2233 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 737477 T2223 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 737477 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 737478 T2223 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 737485 T2223 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 737486 T2223 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60742
[junit4] 2> 737487 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 737487 T2223 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 737487 T2223 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave
[junit4] 2> 737488 T2223 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/'
[junit4] 2> 737495 T2223 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/solr.xml
[junit4] 2> 737495 T2223 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/solr.xml does not exist, using default configuration
[junit4] 2> 737510 T2223 oasc.CoreContainer.<init> New CoreContainer 1774203467
[junit4] 2> 737510 T2223 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/]
[junit4] 2> 737511 T2223 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 737511 T2223 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 737511 T2223 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 737511 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 737511 T2223 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 737512 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 737512 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 737512 T2223 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 737512 T2223 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 737512 T2223 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4] 2> 737516 T2245 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1
[junit4] 2> 737516 T2245 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/'
[junit4] 2> 737528 T2245 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 737533 T2245 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 737533 T2245 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 737535 T2245 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 737537 T2245 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 737537 T2245 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 737538 T2245 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/
[junit4] 2> 737538 T2245 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 737538 T2245 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data
[junit4] 2> 737538 T2245 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index/
[junit4] 2> 737538 T2245 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 737539 T2245 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index
[junit4] 2> 737539 T2245 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_1,generation=1}
[junit4] 2> 737540 T2245 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 737540 T2245 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 737540 T2245 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 737541 T2245 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 737541 T2245 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 737541 T2245 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 737541 T2245 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 737542 T2245 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 737543 T2245 oass.SolrIndexSearcher.<init> Opening Searcher@9f54c96 main
[junit4] 2> 737543 T2245 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 737543 T2245 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 737545 T2245 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4] 2> 737545 T2246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9f54c96 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 737545 T2245 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 737545 T2223 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 737546 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 737546 T2223 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> ASYNC NEW_CORE C1951 name=collection1 org.apache.solr.core.SolrCore@20c15dc9
[junit4] 2> 737552 T2229 C1951 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 737556 T2230 C1951 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_1,generation=1}
[junit4] 2> 737556 T2230 C1951 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 737557 T2230 C1951 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 2
[junit4] 2> 737559 T2231 C1951 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 737560 T2231 C1951 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_2,generation=2}
[junit4] 2> 737560 T2231 C1951 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 737561 T2231 C1951 oass.SolrIndexSearcher.<init> Opening Searcher@7cccebc main
[junit4] 2> 737561 T2231 C1951 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 737561 T2234 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7cccebc main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C1)}
[junit4] 2> 737561 T2231 C1951 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={commit=true&wt=javabin&version=2} {commit=} 0 2
[junit4] 2> 737564 T2249 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 737564 T2249 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 737565 T2232 C1951 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 737565 T2249 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4] 2> 737566 T2249 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4] 2> 737566 T2249 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4] 2> 737569 T2229 C1951 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=2
[junit4] 2> 737570 T2249 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 10
[junit4] 2> 737570 T2249 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917244
[junit4] 2> 737570 T2249 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@4f1b08f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@70f8fba1) fullCopy=false
[junit4] 2> 737572 T2230 C1951 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0_Direct_0.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4] 2> 737575 T2231 C1951 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4] 2> ASYNC NEW_CORE C1952 name=collection1 org.apache.solr.core.SolrCore@20c15dc9
[junit4] 2> 737586 T2232 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4] 2> 737589 T2229 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4] 2> 737591 T2230 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0_Direct_0.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4] 2> 737593 T2231 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4] 2> 737596 T2232 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4] 2> 737598 T2229 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4] 2> 737601 T2230 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0_Direct_0.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=1
[junit4] 2> 737603 T2231 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_0.fdt&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4] 2> 737604 T2249 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4] 2> 737604 T2249 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4] 2> 737604 T2249 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 737605 T2249 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4] 2> 737606 T2249 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_2,generation=2}
[junit4] 2> 737606 T2249 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 737606 T2249 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 737607 T2249 oass.SolrIndexSearcher.<init> Opening Searcher@43d68a86 main
[junit4] 2> 737607 T2246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@43d68a86 main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C1)}
[junit4] 2> 737607 T2249 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917244 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917244;done=true>>]
[junit4] 2> 737607 T2249 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917244
[junit4] 2> ASYNC NEW_CORE C1953 name=collection1 org.apache.solr.core.SolrCore@3c9a6c86
[junit4] 2> 737607 T2241 C1953 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:58207/solr/replication&command=fetchindex&wait=true} status=0 QTime=44
[junit4] 2> 737610 T2242 C1953 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:empty1&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 737613 T2232 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=1
[junit4] 2> 737615 T2229 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737619 T2230 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737620 T2243 C1953 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=3
[junit4] 2> 737621 T2231 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737623 T2244 C1953 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737625 T2232 C1952 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 737625 T2232 C1952 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
[junit4] 2> 737626 T2232 C1952 oass.SolrIndexSearcher.<init> Opening Searcher@685af8ff main
[junit4] 2> 737626 T2232 C1952 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 737626 T2234 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@685af8ff main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):C1)}
[junit4] 2> 737626 T2232 C1952 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={commit=true&wt=javabin&version=2} {commit=} 0 1
[junit4] 2> 737627 T2252 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 737628 T2252 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 737629 T2229 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 737630 T2252 oash.SnapPuller.fetchLatestIndex Slave in sync with master.
[junit4] 2> 737630 T2241 C1953 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:58207/solr/replication&command=fetchindex&wait=true} status=0 QTime=3
[junit4] 2> 737632 T2230 C1952 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4] 2> 737634 T2231 C1952 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 737635 T2231 C1952 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_3,generation=3}
[junit4] 2> 737636 T2231 C1952 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 737637 T2231 C1952 oass.SolrIndexSearcher.<init> Opening Searcher@4255271f main
[junit4] 2> 737637 T2231 C1952 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 737637 T2234 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4255271f main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):C1 _1(5.0):C1)}
[junit4] 2> 737637 T2231 C1952 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={commit=true&wt=javabin&version=2} {commit=} 0 3
[junit4] 2> 737639 T2253 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 737639 T2253 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 737640 T2232 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 737641 T2253 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4] 2> 737641 T2253 oash.SnapPuller.fetchLatestIndex Slave's generation: 2
[junit4] 2> 737641 T2253 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4] 2> 737643 T2229 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0
[junit4] 2> 737643 T2253 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 19
[junit4] 2> 737644 T2253 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917317
[junit4] 2> 737644 T2253 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@3b321ee4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60517902) fullCopy=false
[junit4] 2> 737646 T2230 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4] 2> 737648 T2231 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1_Direct_0.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4] 2> 737649 T2253 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fnm because it already exists
[junit4] 2> 737651 T2232 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4] 2> 737652 T2253 oash.SnapPuller.downloadIndexFiles Skipping download for _0.nvm because it already exists
[junit4] 2> 737654 T2229 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4] 2> 737656 T2230 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4] 2> 737657 T2253 oash.SnapPuller.downloadIndexFiles Skipping download for _0_Direct_0.doc because it already exists
[junit4] 2> 737659 T2231 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.fdt&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4] 2> 737661 T2232 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4] 2> 737661 T2253 oash.SnapPuller.downloadIndexFiles Skipping download for _0.nvd because it already exists
[junit4] 2> 737661 T2253 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fdx because it already exists
[junit4] 2> 737662 T2253 oash.SnapPuller.downloadIndexFiles Skipping download for _0_Direct_0.tip because it already exists
[junit4] 2> 737663 T2229 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1_Direct_0.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4] 2> 737664 T2253 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
[junit4] 2> 737664 T2253 oash.SnapPuller.downloadIndexFiles Skipping download for _0_Direct_0.tim because it already exists
[junit4] 2> 737664 T2253 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fdt because it already exists
[junit4] 2> 737666 T2230 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4] 2> 737668 T2231 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_1_Direct_0.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4] 2> 737669 T2253 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4] 2> 737669 T2253 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4] 2> 737669 T2253 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 737670 T2253 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 737670 T2253 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4] 2> 737671 T2253 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_3,generation=3}
[junit4] 2> 737671 T2253 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 737672 T2253 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 737673 T2253 oass.SolrIndexSearcher.<init> Opening Searcher@65cc82b5 main
[junit4] 2> 737673 T2246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65cc82b5 main{StandardDirectoryReader(segments_3:5:nrt _0(5.0):C1 _1(5.0):C1)}
[junit4] 2> 737673 T2253 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917317 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917317;done=true>>]
[junit4] 2> 737673 T2253 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917317
[junit4] 2> 737674 T2242 C1953 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:58207/solr/replication&command=fetchindex&wait=true} status=0 QTime=36
[junit4] 2> 737676 T2243 C1953 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:empty2&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 737678 T2232 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737680 T2229 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737684 T2230 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737684 T2244 C1953 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=2
[junit4] 2> 737686 T2231 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737688 T2241 C1953 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737690 T2232 C1952 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 1
[junit4] 2> 737692 T2229 C1952 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 737693 T2229 C1952 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_3,generation=3}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_4,generation=4}
[junit4] 2> 737694 T2229 C1952 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4] 2> 737694 T2229 C1952 oass.SolrIndexSearcher.<init> Opening Searcher@1bce2442 realtime
[junit4] 2> 737694 T2229 C1952 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 737694 T2229 C1952 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={openSearcher=false&commit=true&wt=javabin&version=2} {commit=} 0 2
[junit4] 2> 737696 T2255 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 737696 T2255 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 737697 T2230 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 737698 T2255 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4] 2> 737698 T2255 oash.SnapPuller.fetchLatestIndex Slave's generation: 3
[junit4] 2> 737698 T2255 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4] 2> 737700 T2231 C1952 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1
[junit4] 2> 737700 T2255 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 28
[junit4] 2> 737701 T2255 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917374
[junit4] 2> 737701 T2255 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@d336df1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6bc27edf) fullCopy=false
[junit4] 2> ASYNC NEW_CORE C1954 name=collection1 org.apache.solr.core.SolrCore@20c15dc9
[junit4] 2> 737710 T2232 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4] 2> 737713 T2229 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2_Direct_0.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4] 2> 737713 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _1_Direct_0.doc because it already exists
[junit4] 2> 737715 T2230 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2_Direct_0.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4] 2> 737716 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _1.fnm because it already exists
[junit4] 2> 737716 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _0.nvd because it already exists
[junit4] 2> 737716 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _1_Direct_0.tim because it already exists
[junit4] 2> 737716 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
[junit4] 2> 737716 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _1_Direct_0.tip because it already exists
[junit4] 2> 737718 T2231 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2_Direct_0.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4] 2> 737718 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _1.nvm because it already exists
[junit4] 2> 737719 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fnm because it already exists
[junit4] 2> 737719 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _1.nvd because it already exists
[junit4] 2> 737720 T2232 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.fdt&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4] 2> 737721 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _0.nvm because it already exists
[junit4] 2> 737723 T2229 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4] 2> 737725 T2230 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4] 2> 737725 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _0_Direct_0.doc because it already exists
[junit4] 2> 737725 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _1.fdx because it already exists
[junit4] 2> 737727 T2231 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4] 2> 737728 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _1.fdt because it already exists
[junit4] 2> 737728 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _1.si because it already exists
[junit4] 2> 737730 T2232 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_2.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=1
[junit4] 2> 737730 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _0_Direct_0.tip because it already exists
[junit4] 2> 737730 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fdx because it already exists
[junit4] 2> 737730 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _0_Direct_0.tim because it already exists
[junit4] 2> 737730 T2255 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fdt because it already exists
[junit4] 2> 737732 T2229 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0
[junit4] 2> 737733 T2255 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4] 2> 737733 T2255 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4] 2> 737733 T2255 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 737734 T2255 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 737734 T2255 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4] 2> 737735 T2255 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=3
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_3,generation=3}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_4,generation=4}
[junit4] 2> 737736 T2255 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4] 2> 737736 T2255 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 737737 T2255 oass.SolrIndexSearcher.<init> Opening Searcher@1ff28017 main
[junit4] 2> 737738 T2246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ff28017 main{StandardDirectoryReader(segments_4:7:nrt _0(5.0):C1 _1(5.0):C1 _2(5.0):C1)}
[junit4] 2> 737738 T2255 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917374 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917374;done=true>>]
[junit4] 2> 737738 T2255 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917374
[junit4] 2> ASYNC NEW_CORE C1955 name=collection1 org.apache.solr.core.SolrCore@3c9a6c86
[junit4] 2> 737738 T2242 C1955 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:58207/solr/replication&command=fetchindex&wait=true} status=0 QTime=43
[junit4] 2> 737741 T2230 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:empty3&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 737743 T2243 C1955 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:empty3&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 737745 T2231 C1954 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
[junit4] 2> 737747 T2232 C1954 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 737748 T2232 C1954 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=4
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_3,generation=3}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_4,generation=4}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@33a986b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@87ac0a7),segFN=segments_5,generation=5}
[junit4] 2> 737748 T2232 C1954 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4] 2> 737749 T2232 C1954 oass.SolrIndexSearcher.<init> Opening Searcher@5dfa1176 main
[junit4] 2> 737749 T2232 C1954 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 737750 T2234 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5dfa1176 main{StandardDirectoryReader(segments_5:9:nrt _0(5.0):C1 _1(5.0):C1 _2(5.0):C1 _3(5.0):C1)}
[junit4] 2> 737750 T2232 C1954 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={commit=true&wt=javabin&version=2} {commit=} 0 3
[junit4] 2> 737751 T2257 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
[junit4] 2> 737751 T2257 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4] 2> 737753 T2229 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 737753 T2257 oash.SnapPuller.fetchLatestIndex Master's generation: 5
[junit4] 2> 737753 T2257 oash.SnapPuller.fetchLatestIndex Slave's generation: 4
[junit4] 2> 737753 T2257 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4] 2> 737755 T2230 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=5&version=2} status=0 QTime=0
[junit4] 2> 737755 T2257 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 37
[junit4] 2> 737756 T2257 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917430
[junit4] 2> 737756 T2257 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@5c761921 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@404f0c61) fullCopy=false
[junit4] 2> 737756 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _2.si because it already exists
[junit4] 2> 737756 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _2_Direct_0.tip because it already exists
[junit4] 2> 737756 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _1_Direct_0.doc because it already exists
[junit4] 2> 737758 T2231 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3_Direct_0.doc&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4] 2> 737759 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _2_Direct_0.tim because it already exists
[junit4] 2> 737760 T2232 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3.fnm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4] 2> 737763 T2229 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3.fdt&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=1
[junit4] 2> 737763 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _1.fnm because it already exists
[junit4] 2> 737765 T2230 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3.nvd&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4] 2> 737765 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _0.nvd because it already exists
[junit4] 2> 737766 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _1_Direct_0.tim because it already exists
[junit4] 2> 737767 T2231 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3.nvm&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4] 2> 737768 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _0.si because it already exists
[junit4] 2> 737768 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _1_Direct_0.tip because it already exists
[junit4] 2> 737768 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _2_Direct_0.doc because it already exists
[junit4] 2> 737768 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _1.nvm because it already exists
[junit4] 2> 737770 T2232 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3_Direct_0.tip&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4] 2> 737770 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fnm because it already exists
[junit4] 2> 737771 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _1.nvd because it already exists
[junit4] 2> 737771 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _2.fdt because it already exists
[junit4] 2> 737771 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _0.nvm because it already exists
[junit4] 2> 737771 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _2.fdx because it already exists
[junit4] 2> 737771 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _2.fnm because it already exists
[junit4] 2> 737773 T2229 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3.fdx&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4] 2> 737773 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _0_Direct_0.doc because it already exists
[junit4] 2> 737773 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _1.fdx because it already exists
[junit4] 2> 737773 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _2.nvm because it already exists
[junit4] 2> 737774 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _1.fdt because it already exists
[junit4] 2> 737774 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _1.si because it already exists
[junit4] 2> 737774 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _2.nvd because it already exists
[junit4] 2> 737774 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _0_Direct_0.tip because it already exists
[junit4] 2> 737774 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fdx because it already exists
[junit4] 2> 737776 T2230 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3.si&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4] 2> 737778 T2231 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=segments_5&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4] 2> 737778 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _0_Direct_0.tim because it already exists
[junit4] 2> 737779 T2257 oash.SnapPuller.downloadIndexFiles Skipping download for _0.fdt because it already exists
[junit4] 2> 737780 T2232 C1954 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={file=_3_Direct_0.tim&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=5} status=0 QTime=0
[junit4] 2> 737788 T2257 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4] 2> 737789 T2257 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
[junit4] 2> 737789 T2257 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 737789 T2257 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
[junit4] 2> 737790 T2257 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
[junit4] 2> 737792 T2257 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=4
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_3,generation=3}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_4,generation=4}
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a3a7e66 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7542c7e8),segFN=segments_5,generation=5}
[junit4] 2> 737792 T2257 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4] 2> 737792 T2257 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 737794 T2257 oass.SolrIndexSearcher.<init> Opening Searcher@44b4f19d main
[junit4] 2> 737794 T2246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@44b4f19d main{StandardDirectoryReader(segments_5:9:nrt _0(5.0):C1 _1(5.0):C1 _2(5.0):C1 _3(5.0):C1)}
[junit4] 2> 737794 T2257 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917430 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917430;done=true>>]
[junit4] 2> 737794 T2257 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index.20130805070917430
[junit4] 2> ASYNC NEW_CORE C1956 name=collection1 org.apache.solr.core.SolrCore@3c9a6c86
[junit4] 2> 737794 T2244 C1956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:58207/solr/replication&command=fetchindex&wait=true} status=0 QTime=43
[junit4] 2> ASYNC NEW_CORE C1957 name=collection1 org.apache.solr.core.SolrCore@20c15dc9
[junit4] 2> 737797 T2229 C1957 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:(empty1+empty2+empty3+empty4)&wt=javabin&version=2} hits=4 status=0 QTime=0
[junit4] 2> 737800 T2241 C1956 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={sort=id+desc&q=name:(empty1+empty2+empty3+empty4)&wt=javabin&version=2} hits=4 status=0 QTime=1
[junit4] 2> 737802 T2230 C1957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737804 T2232 C1957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737808 T2229 C1957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&command=details&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737809 T2242 C1956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details&_trace=getDetails&wt=javabin&qt=/replication&version=2} status=0 QTime=3
[junit4] 2> 737811 T2230 C1957 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=1
[junit4] 2> 737812 T2243 C1956 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=indexversion&_trace=assertVersions&wt=javabin&qt=/replication&version=2} status=0 QTime=0
[junit4] 2> 737813 T2223 oas.SolrTestCaseJ4.tearDown ###Ending testEmptyCommits
[junit4] 2> 737834 T2223 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=142637947
[junit4] 2> 737834 T2223 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@20c15dc9
[junit4] 2> 737835 T2223 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=4,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 737835 T2223 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 737835 T2223 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 737835 T2223 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 737836 T2223 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 737836 T2223 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 737836 T2223 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data/index;done=false>>]
[junit4] 2> 737837 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data/index
[junit4] 2> 737837 T2223 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data;done=false>>]
[junit4] 2> 737837 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157068/master/collection1/data
[junit4] 2> 737838 T2223 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 737910 T2223 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1774203467
[junit4] 2> 737911 T2223 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@3c9a6c86
[junit4] 2> 737911 T2223 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 737912 T2223 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 737912 T2223 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 737912 T2223 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 737913 T2223 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 737913 T2223 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 737913 T2223 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index;done=false>>]
[junit4] 2> 737914 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data/index
[junit4] 2> 737914 T2223 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data;done=false>>]
[junit4] 2> 737914 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157155/slave/collection1/data
[junit4] 2> 737915 T2223 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 737973 T2223 oas.SolrTestCaseJ4.setUp ###Starting doTestSnapPullWithMasterUrl
[junit4] 2> 737975 T2223 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 737977 T2223 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:44256
[junit4] 2> 737977 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 737978 T2223 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 737978 T2223 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master
[junit4] 2> 737978 T2223 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/'
[junit4] 2> 737990 T2223 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/solr.xml
[junit4] 2> 737991 T2223 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/solr.xml does not exist, using default configuration
[junit4] 2> 737998 T2223 oasc.CoreContainer.<init> New CoreContainer 1849066840
[junit4] 2> 737998 T2223 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/]
[junit4] 2> 737999 T2223 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 737999 T2223 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 737999 T2223 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 737999 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 737999 T2223 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 738000 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 738000 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 738000 T2223 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 738000 T2223 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 738001 T2223 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4] 2> 738005 T2268 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/collection1
[junit4] 2> 738005 T2268 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/collection1/'
[junit4] 2> 738019 T2268 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 738032 T2268 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 738033 T2268 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 738035 T2268 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 738037 T2268 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 738037 T2268 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 738038 T2268 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/collection1/data/
[junit4] 2> 738038 T2268 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 738038 T2268 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/collection1/data
[junit4] 2> 738038 T2268 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/collection1/data/index/
[junit4] 2> 738038 T2268 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 738039 T2268 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157647/master/collection1/data/index
[junit4] 2> 738040 T2268 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b319f6b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7da74074),segFN=segments_1,generation=1}
[junit4] 2> 738040 T2268 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 738040 T2268 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 738041 T2268 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 738041 T2268 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 738041 T2268 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 738041 T2268 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 738041 T2268 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 738043 T2268 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 738044 T2268 oass.SolrIndexSearcher.<init> Opening Searcher@190947da main
[junit4] 2> 738044 T2268 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 738044 T2268 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 738044 T2268 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 738044 T2268 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 738045 T2269 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@190947da main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 738045 T2268 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 738045 T2223 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 738045 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 738046 T2223 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 738053 T2223 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 738055 T2223 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36945
[junit4] 2> 738055 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 738056 T2223 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 738056 T2223 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave
[junit4] 2> 738056 T2223 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/'
[junit4] 2> 738068 T2223 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/solr.xml
[junit4] 2> 738069 T2223 oasc.ConfigSolr.fromFile /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/solr.xml does not exist, using default configuration
[junit4] 2> 738076 T2223 oasc.CoreContainer.<init> New CoreContainer 700183354
[junit4] 2> 738076 T2223 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/]
[junit4] 2> 738077 T2223 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 738077 T2223 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 738078 T2223 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 738078 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 738078 T2223 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 738079 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 738079 T2223 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 738079 T2223 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 738079 T2223 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 738080 T2223 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4] 2> 738085 T2280 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1
[junit4] 2> 738085 T2280 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/'
[junit4] 2> 738104 T2280 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 738117 T2280 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 738117 T2280 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 738120 T2280 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 738123 T2280 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 738124 T2280 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 738124 T2280 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data/
[junit4] 2> 738124 T2280 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 738125 T2280 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data
[junit4] 2> 738125 T2280 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data/index/
[junit4] 2> 738125 T2280 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 738126 T2280 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data/index
[junit4] 2> 738127 T2280 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3a740c3b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7659343a),segFN=segments_1,generation=1}
[junit4] 2> 738127 T2280 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 738128 T2280 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 738128 T2280 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 738128 T2280 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 738129 T2280 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 738129 T2280 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 738129 T2280 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 738131 T2280 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 738131 T2280 oass.SolrIndexSearcher.<init> Opening Searcher@4e45c8d3 main
[junit4] 2> 738132 T2280 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 738132 T2280 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 738132 T2280 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
[junit4] 2> 738133 T2281 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e45c8d3 main{StandardDirectoryReader(segments_1:1)}
[junit4] 2> 738133 T2280 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 738133 T2223 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 738133 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 738134 T2223 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4] 2> 738158 T2223 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=700183354
[junit4] 2> 738159 T2223 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@6d7b97ef
[junit4] 2> 738159 T2223 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 738160 T2223 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 738160 T2223 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 738160 T2223 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 738161 T2223 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 738161 T2223 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 738161 T2223 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data;done=false>>]
[junit4] 2> 738162 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data
[junit4] 2> 738162 T2223 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data/index;done=false>>]
[junit4] 2> 738162 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672157724/slave/collection1/data/index
[junit4] 2> 738163 T2223 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 738215 T2223 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 738216 T2223 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39210
[junit4] 2> 738217 T2223 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 738217 T2
[...truncated too long message...]
/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219523/repeater/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219523/repeater/collection1/data;done=false>>]
[junit4] 2> 799990 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219523/repeater/collection1/data
[junit4] 2> 799991 T2223 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 800044 T2223 oas.SolrTestCaseJ4.tearDown ###Ending doTestDetails
[junit4] 2> 800065 T2223 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1873245526
[junit4] 2> 800066 T2223 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@4d353832
[junit4] 2> 800066 T2223 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 800066 T2223 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 800067 T2223 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 800067 T2223 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 800067 T2223 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 800068 T2223 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 800068 T2223 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219121/master/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219121/master/collection1/data/index;done=false>>]
[junit4] 2> 800068 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219121/master/collection1/data/index
[junit4] 2> 800069 T2223 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219121/master/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219121/master/collection1/data;done=false>>]
[junit4] 2> 800069 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219121/master/collection1/data
[junit4] 2> 800069 T2223 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 800141 T2223 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=481389838
[junit4] 2> 800142 T2223 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@4d59e8a3
[junit4] 2> 800142 T2223 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4] 2> 800143 T2223 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 800143 T2223 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 800143 T2223 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 800144 T2223 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 800144 T2223 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 800144 T2223 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219206/slave/collection1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219206/slave/collection1/data/index;done=false>>]
[junit4] 2> 800145 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219206/slave/collection1/data/index
[junit4] 2> 800145 T2223 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219206/slave/collection1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219206/slave/collection1/data;done=false>>]
[junit4] 2> 800145 T2223 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./org.apache.solr.handler.TestReplicationHandler$SolrInstance-1375672219206/slave/collection1/data
[junit4] 2> 800145 T2223 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 800200 T2223 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Lucene42: {newname=PostingsFormat(name=Direct), id=PostingsFormat(name=Direct), name=PostingsFormat(name=Direct)}, docValues:{}, sim=DefaultSimilarity, locale=en, timezone=Asia/Yerevan
[junit4] 2> NOTE: Linux 3.2.0-51-generic amd64/Oracle Corporation 1.8.0-ea (64-bit)/cpus=8,threads=1,free=72820680,total=172650496
[junit4] 2> NOTE: All tests run in this JVM: [TestCoreDiscovery, TimeZoneUtilsTest, IndexSchemaRuntimeFieldTest, TestRandomFaceting, CurrencyFieldOpenExchangeTest, TestStressReorder, NoCacheHeaderTest, TestArbitraryIndexDir, SignatureUpdateProcessorFactoryTest, TestQueryTypes, TestSchemaResource, SortByFunctionTest, ClusterStateTest, TestSolrJ, RequiredFieldsTest, BadCopyFieldTest, TestQuerySenderNoQuery, TestBinaryField, SolrCoreCheckLockOnStartupTest, TestDistributedSearch, HdfsLockFactoryTest, MultiTermTest, TestPostingsSolrHighlighter, HdfsUnloadDistributedZkTest, NotRequiredUniqueKeyTest, OpenExchangeRatesOrgProviderTest, TestMergePolicyConfig, TestUniqueKeyFieldResource, SpellPossibilityIteratorTest, TestRTGBase, HdfsDirectoryTest, TestRandomMergePolicy, BasicDistributedZk2Test, TestSystemIdResolver, ShardSplitTest, TestLuceneMatchVersion, StatsComponentTest, SolrIndexConfigTest, UpdateParamsTest, SolrRequestParserTest, LeaderElectionIntegrationTest, HdfsBasicDistributedZk2Test, TestOmitPositions, RequestHandlersTest, JSONWriterTest, BadIndexSchemaTest, TestAnalyzedSuggestions, TestManagedSchemaFieldResource, DocumentAnalysisRequestHandlerTest, TestStressLucene, DirectUpdateHandlerTest, CopyFieldTest, TestDistributedGrouping, URLClassifyProcessorTest, SolrCmdDistributorTest, TestCSVLoader, DocValuesMultiTest, OutputWriterTest, DefaultValueUpdateProcessorTest, TestUpdate, TestLMJelinekMercerSimilarityFactory, PingRequestHandlerTest, ZkSolrClientTest, HighlighterTest, CoreAdminCreateDiscoverTest, IndexBasedSpellCheckerTest, TestLazyCores, TestPartialUpdateDeduplication, TestJmxIntegration, StandardRequestHandlerTest, UniqFieldsUpdateProcessorFactoryTest, FileUtilsTest, TestIndexingPerformance, TestMultiCoreConfBootstrap, TestFastOutputStream, SuggesterWFSTTest, BasicDistributedZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler]
[junit4] Completed on J1 in 62.84s, 14 tests, 1 failure <<< FAILURES!
[...truncated 454 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:389: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:369: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1230: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:873: There were test failures: 320 suites, 1346 tests, 1 failure, 36 ignored (6 assumptions)
Total time: 36 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-ea-b99 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_25) - Build #
6881 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/6881/
Java: 32bit/jdk1.7.0_25 -client -XX:+UseParallelGC
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.impl.CloudSolrServerTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.client.solrj.impl.CloudSolrServerTest: 1) Thread[id=15, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-SendThread(localhost.localdomain:38970), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 2) Thread[id=16, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-EventThread, state=WAITING, group=TGRP-CloudSolrServerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.client.solrj.impl.CloudSolrServerTest:
1) Thread[id=15, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-SendThread(localhost.localdomain:38970), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
2) Thread[id=16, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-EventThread, state=WAITING, group=TGRP-CloudSolrServerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
at __randomizedtesting.SeedInfo.seed([CEE187F02B542D91]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.impl.CloudSolrServerTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=15, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-SendThread(localhost.localdomain:38970), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=15, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-SendThread(localhost.localdomain:38970), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
at __randomizedtesting.SeedInfo.seed([CEE187F02B542D91]:0)
FAILED: org.apache.solr.client.solrj.impl.CloudSolrServerTest.testDistribSearch
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:38970 within 30000 ms
Stack Trace:
java.lang.RuntimeException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:38970 within 30000 ms
at __randomizedtesting.SeedInfo.seed([CEE187F02B542D91:4F0709E85C0B4DAD]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:130)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:93)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:84)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:190)
at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:71)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:771)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:724)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:38970 within 30000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:173)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:127)
... 46 more
Build Log:
[...truncated 10659 lines...]
[junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrServerTest
[junit4] 2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
[junit4] 2> 1191 T9 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /c/fg
[junit4] 2> 1200 T9 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
[junit4] 2> 1220 T9 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-CloudSolrServerTest-1375678149460
[junit4] 2> 1223 T9 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1226 T10 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1325 T9 oasc.ZkTestServer.run start zk server on port:38970
[junit4] 2> 1376 T9 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 32271 T13 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 30552ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 32281 T11 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1404cceb39b0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2>
[junit4] 2> 32284 T16 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8b80c3 name:ZooKeeperConnection Watcher:127.0.0.1:38970 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 32285 T16 oascc.ConnectionManager.process Client->ZooKeeper status change trigger but we are already closed
[junit4] 2> 32325 T9 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 32327 T9 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:38970 38970
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.method=testDistribSearch -Dtests.seed=CEE187F02B542D91 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_CA -Dtests.timezone=Europe/Simferopol -Dtests.file.encoding=UTF-8
[junit4] ERROR 31.6s J0 | CloudSolrServerTest.testDistribSearch <<<
[junit4] > Throwable #1: java.lang.RuntimeException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:38970 within 30000 ms
[junit4] > at __randomizedtesting.SeedInfo.seed([CEE187F02B542D91:4F0709E85C0B4DAD]:0)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:130)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:93)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:84)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:89)
[junit4] > at org.apache.solr.cloud.AbstractZkTestCase.buildZooKeeper(AbstractZkTestCase.java:83)
[junit4] > at org.apache.solr.cloud.AbstractDistribZkTestBase.setUp(AbstractDistribZkTestBase.java:70)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.setUp(AbstractFullDistribZkTestBase.java:190)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServerTest.setUp(CloudSolrServerTest.java:71)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:38970 within 30000 ms
[junit4] > at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:173)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:127)
[junit4] > ... 46 more
[junit4] 2> 32792 T9 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 31677 T8 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> 32841 T16 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8b80c3 name:ZooKeeperConnection Watcher:127.0.0.1:38970 got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 32841 T16 oascc.ConnectionManager.process Client->ZooKeeper status change trigger but we are already closed
[junit4] 2> 33974 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 35119 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 36505 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 37887 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 39968 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 41653 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 43218 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 44823 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 46689 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 48780 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 50238 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 51932 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 51732 T8 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 2 threads leaked from SUITE scope at org.apache.solr.client.solrj.impl.CloudSolrServerTest:
[junit4] 2> 1) Thread[id=15, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-SendThread(localhost.localdomain:38970), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] 2> 2) Thread[id=16, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-EventThread, state=WAITING, group=TGRP-CloudSolrServerTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
[junit4] 2> 51733 T8 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=15, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-SendThread(localhost.localdomain:38970), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
[junit4] 2> 2) Thread[id=16, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-EventThread, state=WAITING, group=TGRP-CloudSolrServerTest]
[junit4] 2> 52878 T16 oaz.ClientCnxn$EventThread.run ERROR Event thread exiting due to interruption java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2017)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2052)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
[junit4] 2>
[junit4] 2> 52878 T15 oazc.StaticHostProvider.next WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] 2>
[junit4] 2> 52879 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 53378 T15 oaz.ClientCnxn$SendThread.run WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] 2>
[junit4] 2> 53878 T15 oazc.StaticHostProvider.next WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] 2>
[junit4] 2> 53879 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 54378 T15 oaz.ClientCnxn$SendThread.run WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] 2>
[junit4] 2> 54879 T15 oazc.StaticHostProvider.next WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] 2>
[junit4] 2> 54879 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 55379 T15 oazc.StaticHostProvider.next WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] 2>
[junit4] 2> 55380 T15 oaz.ClientCnxn$SendThread.run WARN Session 0x1404cceb39b0002 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:708)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 54735 T8 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=15, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-SendThread(localhost.localdomain:38970), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=en_CA, timezone=Europe/Simferopol
[junit4] 2> NOTE: Linux 3.2.0-51-generic i386/Oracle Corporation 1.7.0_25 (32-bit)/cpus=8,threads=2,free=46848608,total=63176704
[junit4] 2> NOTE: All tests run in this JVM: [CloudSolrServerTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CloudSolrServerTest -Dtests.seed=CEE187F02B542D91 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_CA -Dtests.timezone=Europe/Simferopol -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | CloudSolrServerTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.client.solrj.impl.CloudSolrServerTest:
[junit4] > 1) Thread[id=15, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-SendThread(localhost.localdomain:38970), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] > 2) Thread[id=16, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-EventThread, state=WAITING, group=TGRP-CloudSolrServerTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
[junit4] > at __randomizedtesting.SeedInfo.seed([CEE187F02B542D91]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=15, name=TEST-CloudSolrServerTest.testDistribSearch-seed#[CEE187F02B542D91]-SendThread(localhost.localdomain:38970), state=TIMED_WAITING, group=TGRP-CloudSolrServerTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] > at __randomizedtesting.SeedInfo.seed([CEE187F02B542D91]:0)
[junit4] Completed on J0 in 56.01s, 1 test, 3 errors <<< FAILURES!
[...truncated 140 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:389: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:369: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:194: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1230: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:873: There were test failures: 46 suites, 272 tests, 2 suite-level errors, 1 error, 165 ignored
Total time: 41 minutes 5 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_25 -client -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure