You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "David Alves (JIRA)" <ji...@apache.org> on 2013/03/24 09:33:15 UTC

[jira] [Updated] (DRILL-15) Build HBase storage engine implementation

     [ https://issues.apache.org/jira/browse/DRILL-15?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

David Alves updated DRILL-15:
-----------------------------

    Attachment: DRILL-15.patch

Complete patch that implements the table version of the record reader (i.e. using a table scanner, a more powerful version version that uses a region scanner is next.).

Note: this version only supports READS.

This version scans the table defined in the scan operator and returns all CF's and all column version (some limited filtering and projection on CF/column names should be possible even without the region scanning version).

An identity plan with console as the out operator yields data in this format:
{code}
{
  "rowKey" : "MDAwMQ==",
  "batters" : {
    "1001" : {
      "timestamp" : 1364113347095,
      "value" : "U3RyaW5nU2NhbGFyIFtzZXE9UmVndWxhcl0="
    },
    "1002" : {
      "timestamp" : 1364113347095,
      "value" : "U3RyaW5nU2NhbGFyIFtzZXE9Q2hvY29sYXRlXQ=="
    }
  },
  "metadata" : {
    "name" : {
      "timestamp" : 1364113347095,
      "value" : "U3RyaW5nU2NhbGFyIFtzZXE9Q2FrZV0="
    },
    "ppu" : {
      "timestamp" : 1364113347095,
      "value" : "P+GZmZmZmZo="
    },
    "sales" : {
      "timestamp" : 1364113347095,
      "value" : "AAAAIw=="
    },
    "type" : {
      "timestamp" : 1364113347095,
      "value" : "U3RyaW5nU2NhbGFyIFtzZXE9ZG9udXRd"
    }
  }
} 
...
{code}

The region based version of the record reader is the one that is going to support filter/projection/partial aggregation/local join pushdown, but this one should ba useful already.

Please try/review!
                
> Build HBase storage engine implementation
> -----------------------------------------
>
>                 Key: DRILL-15
>                 URL: https://issues.apache.org/jira/browse/DRILL-15
>             Project: Apache Drill
>          Issue Type: Bug
>            Reporter: Ted Yu
>            Assignee: David Alves
>         Attachments: DRILL-15.patch
>
>


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira