You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/05/22 07:34:42 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_60-ea-b12) - Build # 12775 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/12775/
Java: 32bit/jdk1.8.0_60-ea-b12 -server -XX:+UseSerialGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.client.solrj.embedded.MergeIndexesEmbeddedTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([976BA2FE66231023]:0)


FAILED:  org.apache.solr.client.solrj.embedded.MergeIndexesEmbeddedTest.testMergeIndexesByCoreName

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([976BA2FE66231023]:0)




Build Log:
[...truncated 11624 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.embedded.MergeIndexesEmbeddedTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/init-core-data-001
   [junit4]   2> 41424 T191 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 41426 T191 oas.SolrTestCaseJ4.setUp ###Starting testMergeIndexesByCoreName
   [junit4]   2> 41427 T191 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/'
   [junit4]   2> 41439 T191 oasc.SolrXmlConfig.fromFile Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/solr.xml
   [junit4]   2> 41450 T191 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore
   [junit4]   2> 41451 T191 oasc.CoreContainer.<init> New CoreContainer 2521533
   [junit4]   2> 41451 T191 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/]
   [junit4]   2> 41452 T191 oasc.CoreContainer.load loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/lib
   [junit4]   2> 41452 T191 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/lib).
   [junit4]   2> 41460 T191 oashc.HttpShardHandlerFactory.init created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 41464 T191 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 41465 T191 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 41465 T191 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 41465 T191 oasc.CoreContainer.load Node Name: null
   [junit4]   2> 41466 T191 oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
   [junit4]   2> 41466 T191 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore
   [junit4]   2> 41468 T191 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=core1, config=solrconfig.xml, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core1, loadOnStartup=true, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core1/, schema=schema.xml, transient=false, dataDir=data/}
   [junit4]   2> 41468 T191 oasc.CorePropertiesLocator.discoverUnder Found core core1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core1/
   [junit4]   2> 41469 T191 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=core0, config=solrconfig.xml, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core0, loadOnStartup=true, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core0/, schema=schema.xml, transient=false, dataDir=data/}
   [junit4]   2> 41469 T191 oasc.CorePropertiesLocator.discoverUnder Found core core0 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core0/
   [junit4]   2> 41470 T191 oasc.CorePropertiesLocator.discover Found 2 core definitions
   [junit4]   2> 41473 T192 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core1/'
   [junit4]   2> 41473 T193 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core0/'
   [junit4]   2> 41499 T192 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 41500 T193 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 41509 T192 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 41510 T193 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 41523 T192 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 41524 T192 oass.IndexSchema.readSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core1/conf/schema.xml
   [junit4]   2> 41526 T192 oass.IndexSchema.readSchema [core1] Schema name=example core one
   [junit4]   2> 41535 T192 oass.IndexSchema.readSchema default search field in schema is name
   [junit4]   2> 41536 T192 oass.IndexSchema.readSchema query parser default operator is OR
   [junit4]   2> 41536 T192 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 41536 T192 oasc.CoreContainer.create Creating SolrCore 'core1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core1/
   [junit4]   2> 41536 T192 x:core1 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 41538 T193 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 41539 T193 oass.IndexSchema.readSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core0/conf/schema.xml
   [junit4]   2> 41541 T192 x:core1 oasc.SolrCore.<init> [[core1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core1/], dataDir=[null]
   [junit4]   2> 41542 T192 x:core1 oasc.SolrCore.initInfoRegistry JMX monitoring not detected for core: core1
   [junit4]   2> 41552 T193 oass.IndexSchema.readSchema [core0] Schema name=example core zero
   [junit4]   2> 41561 T192 x:core1 oasc.CachingDirectoryFactory.get return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-002
   [junit4]   2> 41561 T193 oass.IndexSchema.readSchema default search field in schema is name
   [junit4]   2> 41561 T192 x:core1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-002/index/
   [junit4]   2> 41561 T193 oass.IndexSchema.readSchema query parser default operator is OR
   [junit4]   2> 41562 T192 x:core1 oasc.SolrCore.initIndex WARN [core1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-002/index' doesn't exist. Creating new index...
   [junit4]   2> 41562 T193 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 41562 T192 x:core1 oasc.CachingDirectoryFactory.get return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-002/index
   [junit4]   2> 41562 T193 oasc.CoreContainer.create Creating SolrCore 'core0' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core0/
   [junit4]   2> 41562 T193 x:core0 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 41563 T193 x:core0 oasc.SolrCore.<init> [[core0] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core0/], dataDir=[null]
   [junit4]   2> 41563 T193 x:core0 oasc.SolrCore.initInfoRegistry JMX monitoring not detected for core: core0
   [junit4]   2> 41564 T193 x:core0 oasc.CachingDirectoryFactory.get return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-001
   [junit4]   2> 41565 T193 x:core0 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-001/index/
   [junit4]   2> 41565 T193 x:core0 oasc.SolrCore.initIndex WARN [core0] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-001/index' doesn't exist. Creating new index...
   [junit4]   2> 41566 T193 x:core0 oasc.CachingDirectoryFactory.get return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-001/index
   [junit4]   2> 41627 T192 x:core1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-002/index,segFN=segments_1,generation=1}
   [junit4]   2> 41628 T192 x:core1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 41630 T192 x:core1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 41633 T192 x:core1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 41634 T192 x:core1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 41635 T192 x:core1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 41636 T192 x:core1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 41638 T192 x:core1 oasc.PluginBag.createPlugin requestHandler : '/analysis/field' created with startup=lazy 
   [junit4]   2> 41638 T192 x:core1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file,/analysis/field
   [junit4]   2> 41638 T192 x:core1 oasc.RequestHandlers.initHandlersFromConfig WARN no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 41638 T192 x:core1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 41642 T192 x:core1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 41642 T192 x:core1 oasu.UpdateLog.init Initializing UpdateLog: dataDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-002 defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=256
   [junit4]   2> 41643 T192 x:core1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 41644 T192 x:core1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 41645 T193 x:core0 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-001/index,segFN=segments_1,generation=1}
   [junit4]   2> 41645 T193 x:core0 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 41649 T193 x:core0 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 41650 T193 x:core0 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 41667 T192 x:core1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-002/index,segFN=segments_1,generation=1}
   [junit4]   2> 41667 T192 x:core1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 41667 T192 x:core1 oass.SolrIndexSearcher.<init> Opening Searcher@590e2[core1] main
   [junit4]   2> 41667 T192 x:core1 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
   [junit4]   2> 41668 T192 x:core1 oasu.VersionInfo.getMaxVersionFromIndex Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 41668 T192 x:core1 oasu.VersionInfo.getMaxVersionFromIndex WARN No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 41668 T192 x:core1 oasu.UpdateLog.seedBucketsWithHighestVersion WARN Could not find max version in index or recent updates, using new clock 1501839384766316544
   [junit4]   2> 41668 T192 x:core1 oasu.UpdateLog.seedBucketsWithHighestVersion Took 0 ms to seed version buckets with highest version 1501839384766316544
   [junit4]   2> 41668 T192 x:core1 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core1/conf; switching to use InMemory storage instead.
   [junit4]   2> 41669 T192 x:core1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 41669 T192 x:core1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 41669 T192 x:core1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 41669 T192 x:core1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 41667 T193 x:core0 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 41670 T193 x:core0 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 41672 T193 x:core0 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 41673 T193 x:core0 oasc.PluginBag.createPlugin requestHandler : '/analysis/field' created with startup=lazy 
   [junit4]   2> 41673 T193 x:core0 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file,/analysis/field
   [junit4]   2> 41673 T193 x:core0 oasc.RequestHandlers.initHandlersFromConfig WARN no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 41673 T193 x:core0 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 41674 T194 x:core1 oasc.SolrCore.registerSearcher [core1] Registered new searcher Searcher@590e2[core1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 41674 T192 x:core1 oasc.CoreContainer.registerCore registering core: core1
   [junit4]   2> 41683 T193 x:core0 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 41683 T193 x:core0 oasu.UpdateLog.init Initializing UpdateLog: dataDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-001 defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=256
   [junit4]   2> 41684 T193 x:core0 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 41684 T193 x:core0 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 41685 T193 x:core0 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.embedded.MergeIndexesEmbeddedTest 976BA2FE66231023-001/tempDir-001/index,segFN=segments_1,generation=1}
   [junit4]   2> 41685 T193 x:core0 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 41686 T193 x:core0 oass.SolrIndexSearcher.<init> Opening Searcher@6bd238[core0] main
   [junit4]   2> 41686 T193 x:core0 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
   [junit4]   2> 41686 T193 x:core0 oasu.VersionInfo.getMaxVersionFromIndex Refreshing highest value of _version_ for 256 version buckets from index
   [junit4]   2> 41686 T193 x:core0 oasu.VersionInfo.getMaxVersionFromIndex WARN No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 41695 T193 x:core0 oasu.UpdateLog.seedBucketsWithHighestVersion WARN Could not find max version in index or recent updates, using new clock 1501839384785190912
   [junit4]   2> 41695 T193 x:core0 oasu.UpdateLog.seedBucketsWithHighestVersion Took 9 ms to seed version buckets with highest version 1501839384785190912
   [junit4]   2> 41695 T193 x:core0 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/solrj/src/test-files/solrj/solr/multicore/core0/conf; switching to use InMemory storage instead.
   [junit4]   2> 41696 T193 x:core0 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 41696 T193 x:core0 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 41696 T193 x:core0 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 41696 T193 x:core0 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 41696 T193 x:core0 oasc.CoreContainer.registerCore registering core: core0
   [junit4]   2> 41697 T191 oascs.MergeIndexesExampleTestBase.setUp CORES=org.apache.solr.core.CoreContainer@2679bd : [core0, core1]
   [junit4]   2> ASYNC  NEW_CORE C59 name=core0 org.apache.solr.core.SolrCore@1dea35b
   [junit4]   2> 41710 T191 C59 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 41710 T191 C59 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 41711 T191 C59 oasc.SolrCore.getSearcher WARN [core0] PERFORMANCE WARNING: Overlapping onDeckSearchers=2
   [junit4]   2> 41711 T191 C59 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 41712 T191 C59 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
   [junit4]   2> 41712 T195 x:core0 oasc.SolrCore.registerSearcher [core0] Registered new searcher Searcher@6bd238[core0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 7199998 T190 ccr.ThreadLeakControl$2.evaluate WARNING Suite execution timed out: org.apache.solr.client.solrj.embedded.MergeIndexesEmbeddedTest
   [junit4]   2> 	==== jstack at approximately timeout time ====
   [junit4]   2> 	"Thread-69" ID=196 WAITING on java.lang.Object@c589f9
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on java.lang.Object@c589f9
   [junit4]   2> 		at java.lang.Object.wait(Object.java:502)
   [junit4]   2> 		at org.apache.solr.core.CloserThread.run(CoreContainer.java:1035)
   [junit4]   2> 	
   [junit4]   2> 	"searcherExecutor-132-thread-1" ID=195 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4c2918
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4c2918
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 		at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 	"searcherExecutor-131-thread-1" ID=194 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@dadc43
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@dadc43
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 		at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 	"TEST-MergeIndexesEmbeddedTest.testMergeIndexesByCoreName-seed#[976BA2FE66231023]" ID=191 WAITING on java.util.concurrent.locks.ReentrantReadWriteLock$FairSync@500b3a
   [junit4]   2> 		at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 		- waiting on java.util.concurrent.locks.ReentrantReadWriteLock$FairSync@500b3a
   [junit4]   2> 		at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
   [junit4]   2> 		at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
   [junit4]   2> 		at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:943)
   [junit4]   2> 		at org.apache.solr.update.VersionInfo.blockUpdates(VersionInfo.java:119)
   [junit4]   2> 		at org.apache.solr.update.UpdateLog.onFirstSearcher(UpdateLog.java:1604)
   [junit4]   2> 		at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1810)
   [junit4]   2> 		at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1505)
   [junit4]   2> 		at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:617)
   [junit4]   2> 		- locked java.lang.Object@199cfff
   [junit4]   2> 		at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
   [junit4]   2> 		at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
   [junit4]   2> 		at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor.java:1635)
   [junit4]   2> 		at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1612)
   [junit4]   2> 		at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:161)
   [junit4]   2> 		at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
   [junit4]   2> 		at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:78)
   [junit4]   2> 		at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
   [junit4]   2> 		at org.apache.solr.core.SolrCore.execute(SolrCore.java:2051)
   [junit4]   2> 		at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:179)
   [junit4]   2> 		at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
   [junit4]   2> 		at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:152)
   [junit4]   2> 		at org.apache.solr.client.solrj.MergeIndexesExampleTestBase.setupCores(MergeIndexesExampleTestBase.java:117)
   [junit4]   2> 		at org.apache.solr.client.solrj.MergeIndexesExampleTestBase.testMergeIndexesByCoreName(MergeIndexesExampleTestBase.java:173)
   [junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 		at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 		Locked synchronizers:
   [junit4]   2> 		- java.util.concurrent.locks.ReentrantLock$FairSync@1c102b4
   [junit4]   2> 		- java.util.concurrent.locks.ReentrantLock$NonfairSync@2f3fd
   [junit4]   2> 	
   [junit4]   2> 	"SUITE-MergeIndexesEmbeddedTest-seed#[976BA2FE66231023]" ID=190 RUNNABLE
   [junit4]   2> 		at sun.management.ThreadImpl.dumpThreads0(Native Method)
   [junit4]   2> 		at sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:446)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:671)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.access$900(ThreadLeakControl.java:62)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:412)
   [junit4]   2> 		- locked java.lang.Object@14fd3f8
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:651)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:138)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$1.run(RandomizedRunner.java:568)
   [junit4]   2> 	
   [junit4]   2> 	"JUnit4-serializer-daemon" ID=12 TIMED_WAITING
   [junit4]   2> 		at java.lang.Thread.sleep(Native Method)
   [junit4]   2> 		at com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:47)
   [junit4]   2> 	
   [junit4]   2> 	"Signal Dispatcher" ID=4 RUNNABLE
   [junit4]   2> 	
   [junit4]   2> 	"Finalizer" ID=3 WAITING on java.lang.ref.ReferenceQueue$Lock@76b3c7
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on java.lang.ref.ReferenceQueue$Lock@76b3c7
   [junit4]   2> 		at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:143)
   [junit4]   2> 		at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:164)
   [junit4]   2> 		at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)
   [junit4]   2> 	
   [junit4]   2> 	"Reference Handler" ID=2 WAITING on java.lang.ref.Reference$Lock@1de3eaf
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on java.lang.ref.Reference$Lock@1de3eaf
   [junit4]   2> 		at java.lang.Object.wait(Object.java:502)
   [junit4]   2> 		at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:157)
   [junit4]   2> 	
   [junit4]   2> 	"main" ID=1 WAITING on com.carrotsearch.randomizedtesting.RandomizedRunner$1@15edc6c
   [junit4]   2> 		at java.lang.Object.wait(Native Method)
   [junit4]   2> 		- waiting on com.carrotsearch.randomizedtesting.RandomizedRunner$1@15edc6c
   [junit4]   2> 		at java.lang.Thread.join(Thread.java:1245)
   [junit4]   2> 		at java.lang.Thread.join(Thread.java:1319)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:578)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:444)
   [junit4]   2> 		at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:199)
   [junit4]   2> 		at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:310)
   [junit4]   2> 		at com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:12)
   [junit4]   2> 	
   [junit4]   2> 	^^==============================================
   [junit4]   2> 	
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MergeIndexesEmbeddedTest -Dtests.method=testMergeIndexesByCoreName -Dtests.seed=976BA2FE66231023 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hi -Dtests.timezone=America/Los_Angeles -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   7200s J0 | MergeIndexesEmbeddedTest.testMergeIndexesByCoreName <<<
   [junit4]    > Throwable #1: java.lang.Exception: Test abandoned because suite timeout was reached.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([976BA2FE66231023]:0)
   [junit4]   2> 7200019 T190 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 4 leaked thread(s).
   [junit4]   2> 7220074 T190 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 4 threads leaked from SUITE scope at org.apache.solr.client.solrj.embedded.MergeIndexesEmbeddedTest: 
   [junit4]   2> 	   1) Thread[id=194, name=searcherExecutor-131-thread-1, state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	   2) Thread[id=191, name=TEST-MergeIndexesEmbeddedTest.testMergeIndexesByCoreName-seed#[976BA2FE66231023], state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
   [junit4]   2> 	        at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:943)
   [junit4]   2> 	        at org.apache.solr.update.VersionInfo.blockUpdates(VersionInfo.java:119)
   [junit4]   2> 	        at org.apache.solr.update.UpdateLog.onFirstSearcher(UpdateLog.java:1604)
   [junit4]   2> 	        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1810)
   [junit4]   2> 	        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1505)
   [junit4]   2> 	        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:617)
   [junit4]   2> 	        at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
   [junit4]   2> 	        at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
   [junit4]   2> 	        at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor.java:1635)
   [junit4]   2> 	        at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1612)
   [junit4]   2> 	        at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:161)
   [junit4]   2> 	        at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
   [junit4]   2> 	        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:78)
   [junit4]   2> 	        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
   [junit4]   2> 	        at org.apache.solr.core.SolrCore.execute(SolrCore.java:2051)
   [junit4]   2> 	        at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:179)
   [junit4]   2> 	        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
   [junit4]   2> 	        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:152)
   [junit4]   2> 	        at org.apache.solr.client.solrj.MergeIndexesExampleTestBase.setupCores(MergeIndexesExampleTestBase.java:117)
   [junit4]   2> 	        at org.apache.solr.client.solrj.MergeIndexesExampleTestBase.testMergeIndexesByCoreName(MergeIndexesExampleTestBase.java:173)
   [junit4]   2> 	        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	        at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2> 	        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	   3) Thread[id=195, name=searcherExecutor-132-thread-1, state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	   4) Thread[id=196, name=Thread-69, state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.lang.Object.wait(Object.java:502)
   [junit4]   2> 	        at org.apache.solr.core.CloserThread.run(CoreContainer.java:1035)
   [junit4]   2> 7220075 T190 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
   [junit4]   2> 	   1) Thread[id=194, name=searcherExecutor-131-thread-1, state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	   2) Thread[id=191, name=TEST-MergeIndexesEmbeddedTest.testMergeIndexesByCoreName-seed#[976BA2FE66231023], state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	   3) Thread[id=195, name=searcherExecutor-132-thread-1, state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	   4) Thread[id=196, name=Thread-69, state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 7223097 T190 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
   [junit4]   2> 	   1) Thread[id=194, name=searcherExecutor-131-thread-1, state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	   2) Thread[id=191, name=TEST-MergeIndexesEmbeddedTest.testMergeIndexesByCoreName-seed#[976BA2FE66231023], state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:870)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1199)
   [junit4]   2> 	        at java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:943)
   [junit4]   2> 	        at org.apache.solr.update.VersionInfo.blockUpdates(VersionInfo.java:119)
   [junit4]   2> 	        at org.apache.solr.update.UpdateLog.onFirstSearcher(UpdateLog.java:1604)
   [junit4]   2> 	        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1810)
   [junit4]   2> 	        at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1505)
   [junit4]   2> 	        at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:617)
   [junit4]   2> 	        at org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
   [junit4]   2> 	        at org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
   [junit4]   2> 	        at org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor.java:1635)
   [junit4]   2> 	        at org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1612)
   [junit4]   2> 	        at org.apache.solr.update.processor.LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:161)
   [junit4]   2> 	        at org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
   [junit4]   2> 	        at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:78)
   [junit4]   2> 	        at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
   [junit4]   2> 	        at org.apache.solr.core.SolrCore.execute(SolrCore.java:2051)
   [junit4]   2> 	        at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:179)
   [junit4]   2> 	        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
   [junit4]   2> 	        at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:152)
   [junit4]   2> 	        at org.apache.solr.client.solrj.MergeIndexesExampleTestBase.setupCores(MergeIndexesExampleTestBase.java:117)
   [junit4]   2> 	        at org.apache.solr.client.solrj.MergeIndexesExampleTestBase.testMergeIndexesByCoreName(MergeIndexesExampleTestBase.java:173)
   [junit4]   2> 	        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	        at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2> 	        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	   3) Thread[id=195, name=searcherExecutor-132-thread-1, state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	   4) Thread[id=196, name=Thread-69, state=WAITING, group=TGRP-MergeIndexesEmbeddedTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.lang.Object.wait(Object.java:502)
   [junit4]   2> 	        at org.apache.solr.core.CloserThread.run(CoreContainer.java:1035)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=DefaultSimilarity, locale=hi, timezone=America/Los_Angeles
   [junit4]   2> NOTE: Linux 3.13.0-53-generic i386/Oracle Corporation 1.8.0_60-ea (32-bit)/cpus=12,threads=5,free=12416312,total=65798144
   [junit4]   2> NOTE: All tests run in this JVM: [TestRetryUtil, NamedListTest, IteratorChainTest, LargeVolumeEmbeddedTest, TestUpdateRequestCodec, TestEmbeddedSolrServer, CollectionAdminRequestRequiredParamsTest, StreamExpressionParserTest, TestSpellCheckResponse, TestZkConfigManager, SolrExampleStreamingTest, SolrExampleXMLTest, LargeVolumeBinaryJettyTest, TestSolrProperties, TermsResponseTest, MergeIndexesEmbeddedTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MergeIndexesEmbeddedTest -Dtests.seed=976BA2FE66231023 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hi -Dtests.timezone=America/Los_Angeles -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | MergeIndexesEmbeddedTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([976BA2FE66231023]:0)
   [junit4] Completed [60/60] on J0 in 7223.13s, 1 test, 2 errors <<< FAILURES!

[...truncated 12 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:526: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:474: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:242: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:512: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1415: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:973: There were test failures: 60 suites, 389 tests, 1 suite-level error, 1 error

Total time: 164 minutes 51 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any