You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2013/01/09 11:25:38 UTC

[jira] [Commented] (HIVE-1643) support range scans and non-key columns in HBase filter pushdown

    [ https://issues.apache.org/jira/browse/HIVE-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547925#comment-13547925 ] 

Hudson commented on HIVE-1643:
------------------------------

Integrated in Hive-trunk-hadoop2 #54 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/54/])
    HIVE-2771 [jira] Add support for filter pushdown for key ranges in hbase for
keys of type string
(Ashutosh Chauhan via Carl Steinbach)

Summary:
https://issues.apache.org/jira/browse/HIVE-2771

This patch adds support for key range scans pushdown to hbase for keys of type
string. With this patch filter pushdowns of following types are supported:
a) Point lookups for keys of any types.
b) Range scans for keys of type string. 

Test Plan:
Added hbase_ppd_key_range.q which is modeled after hbase_pushdown.q

This is a subtask of HIVE-1643

Test Plan: EMPTY

Reviewers: JIRA, jsichi, cwsteinbach

Reviewed By: cwsteinbach

CC: jsichi, ashutoshc

Differential Revision: https://reviews.facebook.net/D1551 (Revision 1297675)

     Result = ABORTED
cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1297675
Files : 
* /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java
* /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java
* /hive/trunk/hbase-handler/src/test/queries/hbase_ppd_key_range.q
* /hive/trunk/hbase-handler/src/test/results/hbase_ppd_key_range.q.out
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/ppd/OpProcFactory.java

                
> support range scans and non-key columns in HBase filter pushdown
> ----------------------------------------------------------------
>
>                 Key: HIVE-1643
>                 URL: https://issues.apache.org/jira/browse/HIVE-1643
>             Project: Hive
>          Issue Type: Improvement
>          Components: HBase Handler
>    Affects Versions: 0.9.0
>            Reporter: John Sichi
>            Assignee: bharath v
>              Labels: patch
>         Attachments: hbase_handler.patch, Hive-1643.2.patch, HIVE-1643.patch
>
>
> HIVE-1226 added support for WHERE rowkey=3.  We would like to support WHERE rowkey BETWEEN 10 and 20, as well as predicates on non-rowkeys (plus conjunctions etc).  Non-rowkey conditions can't be used to filter out entire ranges, but they can be used to push the per-row filter processing as far down as possible.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira