You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Geoffrey Jacoby (Jira)" <ji...@apache.org> on 2021/07/20 20:07:00 UTC

[jira] [Created] (HBASE-26102) TestingHBaseCluster should support running MapReduce jobs

Geoffrey Jacoby created HBASE-26102:
---------------------------------------

             Summary: TestingHBaseCluster should support running MapReduce jobs
                 Key: HBASE-26102
                 URL: https://issues.apache.org/jira/browse/HBASE-26102
             Project: HBase
          Issue Type: Test
          Components: test
    Affects Versions: 3.0.0-alpha-1
            Reporter: Geoffrey Jacoby


The existing HBaseTestingUtility optionally allows users to start a mini-YARN cluster for the purpose of running MapReduce jobs, such as testing applications that use HBase's MapReduce integration. 

The new TestingHBaseCluster is a cleaner interface than HBTU, but exposes less functionality, and in particular does not seem to allow for starting a YARN minicluster. This would make it difficult to use in some common circumstances, such as testing Phoenix's index builds, which use MapReduce. 

Many downstream projects that depend on HBase may also have batch logic done as MapReduce or other kinds of YARN jobs.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)