You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by "Aditya Kishore (JIRA)" <ji...@apache.org> on 2014/08/27 09:08:59 UTC

[jira] [Created] (DRILL-1346) Use HBase table size information to improve scan parallelization

Aditya Kishore created DRILL-1346:
-------------------------------------

             Summary: Use HBase table size information to improve scan parallelization
                 Key: DRILL-1346
                 URL: https://issues.apache.org/jira/browse/DRILL-1346
             Project: Apache Drill
          Issue Type: Improvement
          Components: Storage - HBase
    Affects Versions: 0.5.0
            Reporter: Aditya Kishore
            Assignee: Aditya Kishore
            Priority: Critical


Currently we use a pseudo-estimated value to calculate the scan size which does not take the actual size of data into account.

HBase, through {{o.a.h.h.client.HBaseAdmin.getClusterStatus()}}, provides a way to retrieve the actual data size of each region. We can use this to approximate the size of scan and use it to improve the scan parallelization.



--
This message was sent by Atlassian JIRA
(v6.2#6252)