You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Ashutosh Chauhan (Created) (JIRA)" <ji...@apache.org> on 2012/02/22 20:29:50 UTC

[jira] [Created] (HIVE-2815) Filter pushdown in hbase for keys stored in binary format

Filter pushdown in hbase for keys stored in binary format
---------------------------------------------------------

                 Key: HIVE-2815
                 URL: https://issues.apache.org/jira/browse/HIVE-2815
             Project: Hive
          Issue Type: Improvement
          Components: HBase Handler
    Affects Versions: 0.8.1, 0.8.0, 0.7.1, 0.7.0, 0.6.0
            Reporter: Ashutosh Chauhan
            Assignee: Ashutosh Chauhan
             Fix For: 0.9.0


This patch enables filter pushdown for keys stored in binary format in hbase

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2815) Filter pushdown in hbase for keys stored in binary format

Posted by "Carl Steinbach (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Carl Steinbach updated HIVE-2815:
---------------------------------

      Resolution: Fixed
    Hadoop Flags: Reviewed
          Status: Resolved  (was: Patch Available)

Committed to trunk. Thanks Ashutosh!
                
> Filter pushdown in hbase for keys stored in binary format
> ---------------------------------------------------------
>
>                 Key: HIVE-2815
>                 URL: https://issues.apache.org/jira/browse/HIVE-2815
>             Project: Hive
>          Issue Type: Improvement
>          Components: HBase Handler
>    Affects Versions: 0.6.0, 0.7.0, 0.7.1, 0.8.0, 0.8.1
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2815.D1875.1.patch, HIVE-2815.D1875.2.patch
>
>
> This patch enables filter pushdown for keys stored in binary format in hbase

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2815) Filter pushdown in hbase for keys stored in binary format

Posted by "Phabricator (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230431#comment-13230431 ] 

Phabricator commented on HIVE-2815:
-----------------------------------

cwsteinbach has accepted the revision "HIVE-2815 [jira] Filter pushdown in hbase for keys stored in binary format".

  +1. Will commit if tests pass.

REVISION DETAIL
  https://reviews.facebook.net/D1875

BRANCH
  svn

                
> Filter pushdown in hbase for keys stored in binary format
> ---------------------------------------------------------
>
>                 Key: HIVE-2815
>                 URL: https://issues.apache.org/jira/browse/HIVE-2815
>             Project: Hive
>          Issue Type: Improvement
>          Components: HBase Handler
>    Affects Versions: 0.6.0, 0.7.0, 0.7.1, 0.8.0, 0.8.1
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2815.D1875.1.patch, HIVE-2815.D1875.2.patch
>
>
> This patch enables filter pushdown for keys stored in binary format in hbase

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2815) Filter pushdown in hbase for keys stored in binary format

Posted by "Phabricator (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230846#comment-13230846 ] 

Phabricator commented on HIVE-2815:
-----------------------------------

ashutoshc has committed the revision "HIVE-2815 [jira] Filter pushdown in hbase for keys stored in binary format".

  Change committed by cws.

REVISION DETAIL
  https://reviews.facebook.net/D1875

COMMIT
  https://reviews.facebook.net/rHIVE1301315

                
> Filter pushdown in hbase for keys stored in binary format
> ---------------------------------------------------------
>
>                 Key: HIVE-2815
>                 URL: https://issues.apache.org/jira/browse/HIVE-2815
>             Project: Hive
>          Issue Type: Improvement
>          Components: HBase Handler
>    Affects Versions: 0.6.0, 0.7.0, 0.7.1, 0.8.0, 0.8.1
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2815.D1875.1.patch, HIVE-2815.D1875.2.patch
>
>
> This patch enables filter pushdown for keys stored in binary format in hbase

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2815) Filter pushdown in hbase for keys stored in binary format

Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ashutosh Chauhan updated HIVE-2815:
-----------------------------------

    Issue Type: New Feature  (was: Improvement)
    
> Filter pushdown in hbase for keys stored in binary format
> ---------------------------------------------------------
>
>                 Key: HIVE-2815
>                 URL: https://issues.apache.org/jira/browse/HIVE-2815
>             Project: Hive
>          Issue Type: New Feature
>          Components: HBase Handler
>    Affects Versions: 0.6.0, 0.7.0, 0.7.1, 0.8.0, 0.8.1
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2815.D1875.1.patch, HIVE-2815.D1875.2.patch
>
>
> This patch enables filter pushdown for keys stored in binary format in hbase

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (HIVE-2815) Filter pushdown in hbase for keys stored in binary format

Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13230955#comment-13230955 ] 

Hudson commented on HIVE-2815:
------------------------------

Integrated in Hive-trunk-h0.21 #1313 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1313/])
    HIVE-2815 [jira] Filter pushdown in hbase for keys stored in binary format
(Ashutosh Chauhan via Carl Steinbach)

Summary:
Further support for pushdown on keys stored in binary format

This patch enables filter pushdown for keys stored in binary format in hbase

Test Plan: Included a new test case.

Reviewers: JIRA, jsichi, njain, cwsteinbach

Reviewed By: cwsteinbach

Differential Revision: https://reviews.facebook.net/D1875 (Revision 1301315)

     Result = FAILURE
cws : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1301315
Files : 
* /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSerDe.java
* /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java
* /hive/trunk/hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java
* /hive/trunk/hbase-handler/src/test/queries/external_table_ppd.q
* /hive/trunk/hbase-handler/src/test/results/external_table_ppd.q.out

                
> Filter pushdown in hbase for keys stored in binary format
> ---------------------------------------------------------
>
>                 Key: HIVE-2815
>                 URL: https://issues.apache.org/jira/browse/HIVE-2815
>             Project: Hive
>          Issue Type: Improvement
>          Components: HBase Handler
>    Affects Versions: 0.6.0, 0.7.0, 0.7.1, 0.8.0, 0.8.1
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2815.D1875.1.patch, HIVE-2815.D1875.2.patch
>
>
> This patch enables filter pushdown for keys stored in binary format in hbase

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2815) Filter pushdown in hbase for keys stored in binary format

Posted by "Ashutosh Chauhan (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ashutosh Chauhan updated HIVE-2815:
-----------------------------------

    Status: Patch Available  (was: Open)
    
> Filter pushdown in hbase for keys stored in binary format
> ---------------------------------------------------------
>
>                 Key: HIVE-2815
>                 URL: https://issues.apache.org/jira/browse/HIVE-2815
>             Project: Hive
>          Issue Type: Improvement
>          Components: HBase Handler
>    Affects Versions: 0.8.1, 0.8.0, 0.7.1, 0.7.0, 0.6.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2815.D1875.1.patch
>
>
> This patch enables filter pushdown for keys stored in binary format in hbase

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2815) Filter pushdown in hbase for keys stored in binary format

Posted by "Phabricator (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Phabricator updated HIVE-2815:
------------------------------

    Attachment: HIVE-2815.D1875.1.patch

ashutoshc requested code review of "HIVE-2815 [jira] Filter pushdown in hbase for keys stored in binary format".
Reviewers: JIRA

  Further support for pushdown on keys stored in binary format

  This patch enables filter pushdown for keys stored in binary format in hbase

TEST PLAN
  Included a new test case.

REVISION DETAIL
  https://reviews.facebook.net/D1875

AFFECTED FILES
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSerDe.java
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java
  hbase-handler/src/test/queries/external_table_ppd.q
  hbase-handler/src/test/results/external_table_ppd.q.out

MANAGE HERALD DIFFERENTIAL RULES
  https://reviews.facebook.net/herald/view/differential/

WHY DID I GET THIS EMAIL?
  https://reviews.facebook.net/herald/transcript/3981/

Tip: use the X-Herald-Rules header to filter Herald messages in your client.

                
> Filter pushdown in hbase for keys stored in binary format
> ---------------------------------------------------------
>
>                 Key: HIVE-2815
>                 URL: https://issues.apache.org/jira/browse/HIVE-2815
>             Project: Hive
>          Issue Type: Improvement
>          Components: HBase Handler
>    Affects Versions: 0.6.0, 0.7.0, 0.7.1, 0.8.0, 0.8.1
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2815.D1875.1.patch
>
>
> This patch enables filter pushdown for keys stored in binary format in hbase

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (HIVE-2815) Filter pushdown in hbase for keys stored in binary format

Posted by "Phabricator (Updated) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-2815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Phabricator updated HIVE-2815:
------------------------------

    Attachment: HIVE-2815.D1875.2.patch

ashutoshc updated the revision "HIVE-2815 [jira] Filter pushdown in hbase for keys stored in binary format".
Reviewers: JIRA, jsichi, njain

  Rebased to trunk.

REVISION DETAIL
  https://reviews.facebook.net/D1875

AFFECTED FILES
  hbase-handler/src/test/results/external_table_ppd.q.out
  hbase-handler/src/test/queries/external_table_ppd.q
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseSerDe.java
  hbase-handler/src/java/org/apache/hadoop/hive/hbase/HBaseStorageHandler.java

                
> Filter pushdown in hbase for keys stored in binary format
> ---------------------------------------------------------
>
>                 Key: HIVE-2815
>                 URL: https://issues.apache.org/jira/browse/HIVE-2815
>             Project: Hive
>          Issue Type: Improvement
>          Components: HBase Handler
>    Affects Versions: 0.6.0, 0.7.0, 0.7.1, 0.8.0, 0.8.1
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>             Fix For: 0.9.0
>
>         Attachments: HIVE-2815.D1875.1.patch, HIVE-2815.D1875.2.patch
>
>
> This patch enables filter pushdown for keys stored in binary format in hbase

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira