You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by "Mark Robert Miller (Jira)" <ji...@apache.org> on 2020/05/11 20:14:00 UTC

[jira] [Resolved] (HBASE-23795) Enable all tests to be run in parallel on reused JVMs.

     [ https://issues.apache.org/jira/browse/HBASE-23795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark Robert Miller resolved HBASE-23795.
----------------------------------------
    Resolution: Information Provided

So I've gone through this pretty thoroughly, though the tests failed on me a lot more than they are currently at the time.

If you use a statics checker and clear large statics and you reinit the right test and runtime statics, and shutdown additional threads and resources that can remain outstanding, these tests  can run in the same JVM about as well as Lucene and Solr tests do, taking advantage of class caching and hotspot, etc.

I've seen all the tests run on my 16-core machine in about 30-40 minutes with a new JVM for every test and parallelism lifted to max load, so perhaps 20 minutes would be in sight with reuse.

> Enable all tests to be run in parallel on reused JVMs.
> ------------------------------------------------------
>
>                 Key: HBASE-23795
>                 URL: https://issues.apache.org/jira/browse/HBASE-23795
>             Project: HBase
>          Issue Type: Wish
>            Reporter: Mark Robert Miller
>            Priority: Major
>
> I'd like to be able to run HBase tests in under 30-40 minutes on good parallel hardware.
> It will require some small changes / fixes for that wish to come true.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)