You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Sandeep Pal (Jira)" <ji...@apache.org> on 2020/08/11 18:42:00 UTC

[jira] [Created] (HBASE-24859) Remove the empty regions from the hbase mapreduce splits

Sandeep Pal created HBASE-24859:
-----------------------------------

             Summary: Remove the empty regions from the hbase mapreduce splits
                 Key: HBASE-24859
                 URL: https://issues.apache.org/jira/browse/HBASE-24859
             Project: HBase
          Issue Type: Improvement
          Components: mapreduce
            Reporter: Sandeep Pal
            Assignee: Sandeep Pal


It has been observed that when the table has too many regions, MR jobs consume more memory in the client. This is because we keep the region level information in memory and the memory heavy object is TableSplit because of Scan object as a part of it.
We can optimize the memory consumption by not loading the region level information if the region is empty. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)