You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/11/05 06:28:46 UTC

[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_45) - Build # 8179 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/8179/
Java: 64bit/jdk1.7.0_45 -XX:+UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  org.apache.solr.client.solrj.embedded.TestEmbeddedSolrServer.testGetCoreContainer

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([70291651318B01F9]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.embedded.TestEmbeddedSolrServer

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([70291651318B01F9]:0)




Build Log:
[...truncated 11341 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.embedded.TestEmbeddedSolrServer
   [junit4]   2> 84475 T302 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/'
   [junit4]   2> 84489 T302 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/solr.xml
   [junit4]   2> 84522 T302 oasc.CoreContainer.<init> New CoreContainer 1526085079
   [junit4]   2> 84522 T302 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/]
   [junit4]   2> 84523 T302 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 84523 T302 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 84524 T302 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 84524 T302 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 84524 T302 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 84524 T302 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 84524 T302 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 84524 T302 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 84525 T302 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 84525 T302 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 84526 T302 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 84531 T303 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/.
   [junit4]   2> 84532 T305 oasc.CoreContainer.create Creating SolrCore 'core1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/.
   [junit4]   2> 84532 T304 oasc.CoreContainer.create Creating SolrCore 'core0' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/.
   [junit4]   2> 84532 T303 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./'
   [junit4]   2> 84532 T305 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./'
   [junit4]   2> 84532 T304 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./'
   [junit4]   2> 84570 T303 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 84578 T304 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 84586 T305 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 84620 T303 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 84620 T303 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 84627 T303 oass.IndexSchema.readSchema [collection1] Schema name=example core 
   [junit4]   2> 84629 T304 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 84629 T304 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 84636 T304 oass.IndexSchema.readSchema [core0] Schema name=example core EN
   [junit4]   2> 84637 T305 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 84637 T305 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 84644 T305 oass.IndexSchema.readSchema [core1] Schema name=example core FR
   [junit4]   2> 84662 T303 oass.IndexSchema.readSchema default search field in schema is name
   [junit4]   2> 84663 T303 oass.IndexSchema.readSchema query parser default operator is OR
   [junit4]   2> 84665 T303 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 84666 T305 oass.IndexSchema.readSchema default search field in schema is name
   [junit4]   2> 84667 T305 oass.IndexSchema.readSchema query parser default operator is OR
   [junit4]   2> 84667 T303 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 84668 T303 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/-/
   [junit4]   2> 84668 T303 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 84668 T305 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 84668 T303 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/-
   [junit4]   2> 84669 T303 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/-/index/
   [junit4]   2> 84669 T303 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/-/index' doesn't exist. Creating new index...
   [junit4]   2> 84669 T303 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/-/index
   [junit4]   2> 84670 T305 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 84670 T305 oasc.SolrCore.<init> [core1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2/
   [junit4]   2> 84670 T305 oasc.SolrCore.<init> JMX monitoring not detected for core: core1
   [junit4]   2> 84670 T305 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2
   [junit4]   2> 84671 T304 oass.IndexSchema.readSchema default search field in schema is name
   [junit4]   2> 84671 T305 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2/index/
   [junit4]   2> 84671 T305 oasc.SolrCore.initIndex WARN [core1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2/index' doesn't exist. Creating new index...
   [junit4]   2> 84671 T303 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7f20557d lockFactory=org.apache.lucene.store.NativeFSLockFactory@58421ef8),segFN=segments_1,generation=1}
   [junit4]   2> 84671 T305 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2/index
   [junit4]   2> 84671 T303 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84672 T304 oass.IndexSchema.readSchema query parser default operator is OR
   [junit4]   2> 84673 T303 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 84673 T305 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6cce87af lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e8a9f4e),segFN=segments_1,generation=1}
   [junit4]   2> 84673 T303 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 84673 T305 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84674 T304 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 84674 T303 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 84674 T303 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 84675 T305 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 84675 T305 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 84675 T305 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 84675 T305 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 84677 T304 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 84677 T303 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 84677 T305 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 84677 T304 oasc.SolrCore.<init> [core0] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1/
   [junit4]   2> 84678 T304 oasc.SolrCore.<init> JMX monitoring not detected for core: core0
   [junit4]   2> 84678 T304 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1
   [junit4]   2> 84678 T304 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1/index/
   [junit4]   2> 84679 T304 oasc.SolrCore.initIndex WARN [core0] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1/index' doesn't exist. Creating new index...
   [junit4]   2> 84679 T304 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1/index
   [junit4]   2> 84680 T303 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 84680 T305 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 84680 T303 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 84680 T305 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 84681 T304 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4c9166e7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@15f5a43),segFN=segments_1,generation=1}
   [junit4]   2> 84681 T304 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84681 T303 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7f20557d lockFactory=org.apache.lucene.store.NativeFSLockFactory@58421ef8),segFN=segments_1,generation=1}
   [junit4]   2> 84681 T303 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84682 T303 oass.SolrIndexSearcher.<init> Opening Searcher@4cc36185 main
   [junit4]   2> 84682 T304 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 84682 T304 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 84683 T304 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 84683 T304 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 84681 T305 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6cce87af lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e8a9f4e),segFN=segments_1,generation=1}
   [junit4]   2> 84683 T303 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 84683 T306 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4cc36185 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 84683 T305 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84684 T305 oass.SolrIndexSearcher.<init> Opening Searcher@22cec4e main
   [junit4]   2> 84685 T304 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 84686 T305 oasc.CoreContainer.registerCore registering core: core1
   [junit4]   2> 84686 T307 oasc.SolrCore.registerSearcher [core1] Registered new searcher Searcher@22cec4e main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 84688 T304 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 84688 T304 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 84689 T304 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4c9166e7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@15f5a43),segFN=segments_1,generation=1}
   [junit4]   2> 84689 T304 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84689 T304 oass.SolrIndexSearcher.<init> Opening Searcher@40cc6052 main
   [junit4]   2> 84690 T308 oasc.SolrCore.registerSearcher [core0] Registered new searcher Searcher@40cc6052 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 84690 T304 oasc.CoreContainer.registerCore registering core: core0
   [junit4]   2> 84691 T302 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1526085079
   [junit4]   2> 84692 T302 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7605cce6
   [junit4]   2> 84692 T302 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 84692 T302 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 84692 T302 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 84693 T302 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 84694 T302 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 84694 T302 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 84694 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/-/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/-/index;done=false>>]
   [junit4]   2> 84695 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/-/index
   [junit4]   2> 84695 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/- [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/-;done=false>>]
   [junit4]   2> 84695 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data/-
   [junit4]   2> 84695 T302 oasc.SolrCore.close [core1]  CLOSING SolrCore org.apache.solr.core.SolrCore@134d8c8
   [junit4]   2> 84695 T302 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 84696 T302 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 84696 T302 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 84696 T302 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 84697 T302 oasc.SolrCore.closeSearcher [core1] Closing main searcher on request.
   [junit4]   2> 84697 T302 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 84697 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2;done=false>>]
   [junit4]   2> 84698 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2
   [junit4]   2> 84698 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2/index;done=false>>]
   [junit4]   2> 84698 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data2/index
   [junit4]   2> 84698 T302 oasc.SolrCore.close [core0]  CLOSING SolrCore org.apache.solr.core.SolrCore@5a8525ff
   [junit4]   2> 84698 T302 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 84699 T302 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 84699 T302 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 84699 T302 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 84700 T302 oasc.SolrCore.closeSearcher [core0] Closing main searcher on request.
   [junit4]   2> 84700 T302 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 84700 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1/index;done=false>>]
   [junit4]   2> 84701 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1/index
   [junit4]   2> 84701 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1;done=false>>]
   [junit4]   2> 84701 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103118/data1
   [junit4]   2> 84701 T302 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1526085079
   [junit4]   1> Solr home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared
   [junit4]   2> 84707 T302 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/'
   [junit4]   2> 84717 T302 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/solr.xml
   [junit4]   2> 84762 T302 oasc.CoreContainer.<init> New CoreContainer 24713244
   [junit4]   2> 84762 T302 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/]
   [junit4]   2> 84764 T302 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 84764 T302 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 84764 T302 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 84764 T302 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 84765 T302 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 84765 T302 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 84765 T302 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 84765 T302 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 84766 T302 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 84767 T302 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 84767 T302 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 84778 T310 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/.
   [junit4]   2> 84779 T310 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./'
   [junit4]   2> 84793 T311 oasc.CoreContainer.create Creating SolrCore 'core0' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/.
   [junit4]   2> 84793 T311 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./'
   [junit4]   2> 84802 T312 oasc.CoreContainer.create Creating SolrCore 'core1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/.
   [junit4]   2> 84803 T312 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./'
   [junit4]   2> 84825 T310 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 84840 T311 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 84863 T312 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 84882 T310 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 84883 T310 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 84890 T310 oass.IndexSchema.readSchema [collection1] Schema name=example core 
   [junit4]   2> 84898 T311 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 84899 T311 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 84907 T311 oass.IndexSchema.readSchema [core0] Schema name=example core EN
   [junit4]   2> 84907 T312 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 84908 T312 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 84915 T312 oass.IndexSchema.readSchema [core1] Schema name=example core FR
   [junit4]   2> 84928 T310 oass.IndexSchema.readSchema default search field in schema is name
   [junit4]   2> 84929 T310 oass.IndexSchema.readSchema query parser default operator is OR
   [junit4]   2> 84930 T310 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 84933 T310 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 84933 T310 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/-/
   [junit4]   2> 84933 T310 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 84934 T310 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/-
   [junit4]   2> 84935 T310 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/-/index/
   [junit4]   2> 84935 T310 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/-/index' doesn't exist. Creating new index...
   [junit4]   2> 84935 T310 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/-/index
   [junit4]   2> 84943 T310 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3b2fcb7f lockFactory=org.apache.lucene.store.NativeFSLockFactory@cbe9988),segFN=segments_1,generation=1}
   [junit4]   2> 84943 T310 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84944 T310 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 84945 T310 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 84945 T310 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 84946 T310 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 84949 T311 oass.IndexSchema.readSchema default search field in schema is name
   [junit4]   2> 84949 T310 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 84949 T312 oass.IndexSchema.readSchema default search field in schema is name
   [junit4]   2> 84950 T311 oass.IndexSchema.readSchema query parser default operator is OR
   [junit4]   2> 84950 T312 oass.IndexSchema.readSchema query parser default operator is OR
   [junit4]   2> 84951 T312 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 84951 T311 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 84952 T310 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 84952 T310 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 84953 T310 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3b2fcb7f lockFactory=org.apache.lucene.store.NativeFSLockFactory@cbe9988),segFN=segments_1,generation=1}
   [junit4]   2> 84953 T312 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 84953 T310 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84953 T311 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 84954 T310 oass.SolrIndexSearcher.<init> Opening Searcher@4072b422 main
   [junit4]   2> 84954 T311 oasc.SolrCore.<init> [core0] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1/
   [junit4]   2> 84954 T311 oasc.SolrCore.<init> JMX monitoring not detected for core: core0
   [junit4]   2> 84954 T312 oasc.SolrCore.<init> [core1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared/./, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2/
   [junit4]   2> 84955 T312 oasc.SolrCore.<init> JMX monitoring not detected for core: core1
   [junit4]   2> 84955 T313 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4072b422 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 84954 T310 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 84955 T311 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1
   [junit4]   2> 84955 T312 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2
   [junit4]   2> 84955 T311 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1/index/
   [junit4]   2> 84956 T312 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2/index/
   [junit4]   2> 84956 T311 oasc.SolrCore.initIndex WARN [core0] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1/index' doesn't exist. Creating new index...
   [junit4]   2> 84956 T312 oasc.SolrCore.initIndex WARN [core1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2/index' doesn't exist. Creating new index...
   [junit4]   2> 84956 T311 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1/index
   [junit4]   2> 84957 T312 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2/index
   [junit4]   2> 84958 T311 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@33a337d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5c463f1a),segFN=segments_1,generation=1}
   [junit4]   2> 84958 T311 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84958 T312 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@344c834c lockFactory=org.apache.lucene.store.NativeFSLockFactory@3feac9e8),segFN=segments_1,generation=1}
   [junit4]   2> 84959 T312 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84959 T311 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 84960 T312 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 84960 T311 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 84960 T312 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 84960 T311 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 84960 T312 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 84961 T311 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 84961 T312 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 84964 T312 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 84964 T311 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 84967 T312 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 84967 T311 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 84968 T311 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 84967 T312 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 84969 T312 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@344c834c lockFactory=org.apache.lucene.store.NativeFSLockFactory@3feac9e8),segFN=segments_1,generation=1}
   [junit4]   2> 84969 T312 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84969 T311 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@33a337d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5c463f1a),segFN=segments_1,generation=1}
   [junit4]   2> 84969 T311 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84969 T312 oass.SolrIndexSearcher.<init> Opening Searcher@6b450419 main
   [junit4]   2> 84969 T311 oass.SolrIndexSearcher.<init> Opening Searcher@29e8aed4 main
   [junit4]   2> 84970 T314 oasc.SolrCore.registerSearcher [core1] Registered new searcher Searcher@6b450419 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 84970 T312 oasc.CoreContainer.registerCore registering core: core1
   [junit4]   2> 84970 T311 oasc.CoreContainer.registerCore registering core: core0
   [junit4]   2> 84970 T315 oasc.SolrCore.registerSearcher [core0] Registered new searcher Searcher@29e8aed4 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 84972 T302 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=24713244
   [junit4]   1> Solr home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/shared
   [junit4]   2> 7202849 T301 ccr.ThreadLeakControl$2.evaluate WARNING Suite execution timed out: org.apache.solr.client.solrj.embedded.TestEmbeddedSolrServer
   [junit4]   2> 	==== jstack at approximately timeout time ====
   [junit4]   2> 	"Thread-196" ID=316 WAITING on java.lang.Object@2731ef5c
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on java.lang.Object@2731ef5c
   [junit4]   2> 		at java.lang.Object.wait(Object.java:503)
   [junit4]   2> 		at org.apache.solr.core.CloserThread.run(CoreContainer.java:995)
   [junit4]   2> 	
   [junit4]   2> 	"searcherExecutor-168-thread-1" ID=315 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3f59951e
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@3f59951e
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 		at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"searcherExecutor-167-thread-1" ID=314 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@124d0510
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@124d0510
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 		at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"searcherExecutor-163-thread-1" ID=313 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7e8766d2
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@7e8766d2
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 		at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"TEST-TestEmbeddedSolrServer.testGetCoreContainer-seed#[70291651318B01F9]" ID=302 WAITING on org.apache.solr.core.CloserThread@6b6fa5e3
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on org.apache.solr.core.CloserThread@6b6fa5e3
   [junit4]   2> 		at java.lang.Thread.join(Thread.java:1280)
   [junit4]   2> 		at java.lang.Thread.join(Thread.java:1354)
   [junit4]   2> 		at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:384)
   [junit4]   2> 		at org.apache.solr.client.solrj.embedded.AbstractEmbeddedSolrServerTestCase.tearDown(AbstractEmbeddedSolrServerTestCase.java:75)
   [junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
   [junit4]   2> 		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 		at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:795)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
   [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
   [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"SUITE-TestEmbeddedSolrServer-seed#[70291651318B01F9]" ID=301 RUNNABLE
   [junit4]   2> 		at sun.management.ThreadImpl.dumpThreads0(Native Method)
   [junit4]   2> 		at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:446)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:655)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$800(ThreadLeakControl.java:60)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:396)
   [junit4]   2> 		- locked java.lang.Object@6ef4112f
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:556)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:79)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$1.run(RandomizedRunner.java:492)
   [junit4]   2> 	
   [junit4]   2> 	"aliveCheckExecutor-22-thread-1" ID=244 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@59945d91
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- timed waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@59945d91
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
   [junit4]   2> 		at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
   [junit4]   2> 		at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"aliveCheckExecutor-17-thread-1" ID=195 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1b8b0889
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- timed waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@1b8b0889
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
   [junit4]   2> 		at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
   [junit4]   2> 		at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"aliveCheckExecutor-12-thread-1" ID=146 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@44dd687f
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- timed waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@44dd687f
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
   [junit4]   2> 		at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
   [junit4]   2> 		at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	
   [junit4]   2> 	"Signal Dispatcher" ID=4 RUNNABLE
   [junit4]   2> 	
   [junit4]   2> 	"Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@23f78d2b
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on java.lang.ref.ReferenceQueue$Lock@23f78d2b
   [junit4]   2> 		at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
   [junit4]   2> 		at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
   [junit4]   2> 		at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
   [junit4]   2> 	
   [junit4]   2> 	"Reference Handler" ID=2 WAITING on java.lang.ref.Reference$Lock@5155147f
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on java.lang.ref.Reference$Lock@5155147f
   [junit4]   2> 		at java.lang.Object.wait(Object.java:503)
   [junit4]   2> 		at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
   [junit4]   2> 	
   [junit4]   2> 	"main" ID=1 WAITING on com.carrotsearch.randomizedtesting.RandomizedRunner$1@43cd182e
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on com.carrotsearch.randomizedtesting.RandomizedRunner$1@43cd182e
   [junit4]   2> 		at java.lang.Thread.join(Thread.java:1280)
   [junit4]   2> 		at java.lang.Thread.join(Thread.java:1354)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:502)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:399)
   [junit4]   2> 		at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:180)
   [junit4]   2> 		at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:275)
   [junit4]   2> 		at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:12)
   [junit4]   2> 	
   [junit4]   2> 	^^==============================================
   [junit4]   2> 	
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestEmbeddedSolrServer -Dtests.method=testGetCoreContainer -Dtests.seed=70291651318B01F9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_MT -Dtests.timezone=Europe/Isle_of_Man -Dtests.file.encoding=UTF-8
   [junit4] ERROR   7200s J0 | TestEmbeddedSolrServer.testGetCoreContainer <<<
   [junit4]    > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([70291651318B01F9]:0)
   [junit4]   2> 7202877 T301 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 5 leaked thread(s).
   [junit4]   2> 7223086 T301 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 5 threads leaked from SUITE scope at org.apache.solr.client.solrj.embedded.TestEmbeddedSolrServer: 
   [junit4]   2> 	   1) Thread[id=313, name=searcherExecutor-163-thread-1, state=WAITING, group=TGRP-TestEmbeddedSolrServer]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	   2) Thread[id=315, name=searcherExecutor-168-thread-1, state=WAITING, group=TGRP-TestEmbeddedSolrServer]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	   3) Thread[id=314, name=searcherExecutor-167-thread-1, state=WAITING, group=TGRP-TestEmbeddedSolrServer]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	   4) Thread[id=302, name=TEST-TestEmbeddedSolrServer.testGetCoreContainer-seed#[70291651318B01F9], state=WAITING, group=TGRP-TestEmbeddedSolrServer]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.lang.Thread.join(Thread.java:1280)
   [junit4]   2> 	        at java.lang.Thread.join(Thread.java:1354)
   [junit4]   2> 	        at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:384)
   [junit4]   2> 	        at org.apache.solr.client.solrj.embedded.AbstractEmbeddedSolrServerTestCase.tearDown(AbstractEmbeddedSolrServerTestCase.java:75)
   [junit4]   2> 	        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
   [junit4]   2> 	        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	        at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:795)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
   [junit4]   2> 	        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
   [junit4]   2> 	        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	   5) Thread[id=316, name=Thread-196, state=WAITING, group=TGRP-TestEmbeddedSolrServer]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.lang.Object.wait(Object.java:503)
   [junit4]   2> 	        at org.apache.solr.core.CloserThread.run(CoreContainer.java:995)
   [junit4]   2> 7223087 T301 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
   [junit4]   2> 	   1) Thread[id=313, name=searcherExecutor-163-thread-1, state=WAITING, group=TGRP-TestEmbeddedSolrServer]
   [junit4]   2> 	   2) Thread[id=315, name=searcherExecutor-168-thread-1, state=WAITING, group=TGRP-TestEmbeddedSolrServer]
   [junit4]   2> 	   3) Thread[id=314, name=searcherExecutor-167-thread-1, state=WAITING, group=TGRP-TestEmbeddedSolrServer]
   [junit4]   2> 	   4) Thread[id=302, name=TEST-TestEmbeddedSolrServer.testGetCoreContainer-seed#[70291651318B01F9], state=WAITING, group=TGRP-TestEmbeddedSolrServer]
   [junit4]   2> 	   5) Thread[id=316, name=Thread-196, state=WAITING, group=TGRP-TestEmbeddedSolrServer]
   [junit4]   2> 7304720 T302 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4ed0efda
   [junit4]   2> 7304720 T302 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 7304721 T302 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 7304721 T302 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 7304721 T302 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 7304723 T302 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 7304723 T302 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 7304723 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/-/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/-/index;done=false>>]
   [junit4]   2> 7304723 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/-/index
   [junit4]   2> 7304724 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/- [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/-;done=false>>]
   [junit4]   2> 7304724 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data/-
   [junit4]   2> 7304724 T302 oasc.SolrCore.close [core1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1fdc9cf0
   [junit4]   2> 7304725 T302 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 7304725 T302 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 7304725 T302 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 7304726 T302 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 7304727 T302 oasc.SolrCore.closeSearcher [core1] Closing main searcher on request.
   [junit4]   2> 7304728 T302 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 7304728 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2/index;done=false>>]
   [junit4]   2> 7304728 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2/index
   [junit4]   2> 7304729 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2;done=false>>]
   [junit4]   2> 7304729 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data2
   [junit4]   2> 7304729 T302 oasc.SolrCore.close [core0]  CLOSING SolrCore org.apache.solr.core.SolrCore@4cc360e7
   [junit4]   2> 7304729 T302 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 7304730 T302 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 7304730 T302 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 7304730 T302 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 7304732 T302 oasc.SolrCore.closeSearcher [core0] Closing main searcher on request.
   [junit4]   2> 7304732 T302 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 7304732 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1;done=false>>]
   [junit4]   2> 7304733 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1
   [junit4]   2> 7304733 T302 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1/index;done=false>>]
   [junit4]   2> 7304733 T302 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/./solrtest-TestEmbeddedSolrServer-1383622103350/data1/index
   [junit4]   2> 7223106 T301 ccr.ThreadLeakControl.tryToInterruptAll All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=en_MT, timezone=Europe/Isle_of_Man
   [junit4]   2> NOTE: Linux 3.8.0-32-generic amd64/Oracle Corporation 1.7.0_45 (64-bit)/cpus=8,threads=1,free=81572504,total=263716864
   [junit4]   2> NOTE: All tests run in this JVM: [SolrParamTest, TermsResponseTest, SolrExceptionTest, SolrExampleEmbeddedTest, SolrExampleStreamingBinaryTest, LargeVolumeEmbeddedTest, SolrExampleXMLTest, ClientUtilsTest, TestUpdateRequestCodec, AnlysisResponseBaseTest, ModifiableSolrParamsTest, TestLBHttpSolrServer, LargeVolumeBinaryJettyTest, TestSpellCheckResponse, TestSolrProperties, TestEmbeddedSolrServer]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestEmbeddedSolrServer -Dtests.seed=70291651318B01F9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_MT -Dtests.timezone=Europe/Isle_of_Man -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | TestEmbeddedSolrServer (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([70291651318B01F9]:0)
   [junit4] Completed on J0 in 7220.33s, 2 tests, 2 errors <<< FAILURES!

[...truncated 11 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:421: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:401: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:471: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1259: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:902: There were test failures: 46 suites, 275 tests, 1 suite-level error, 1 error

Total time: 165 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_45 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure