You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2015/03/03 06:33:05 UTC

[jira] [Created] (HBASE-13144) Avoid writing files to disk in unit tests

Andrew Purtell created HBASE-13144:
--------------------------------------

             Summary: Avoid writing files to disk in unit tests
                 Key: HBASE-13144
                 URL: https://issues.apache.org/jira/browse/HBASE-13144
             Project: HBase
          Issue Type: Test
            Reporter: Andrew Purtell


We have a number of unit tests that read and write relatively small files, but do it often and run under a timeout clock. If the build or test host is virtual or IO contended or both then the test can become flaky. Even if the host is up to the IO pressure the test would run a lot faster if we were not asking the OS to persist anything. Consider both:
- If built against Hadoop 2.6+, spin up miniclusters that keep all blocks in memory-only storage
- Write a simple Hadoop filesystem implementation (or find one) that keeps all state in memory and use in lieu of LocalFileSystem for unit tests. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)