[jira] [Comment Edited] (HIVE-10289) Support filter on non-first partition key and non-string partition key

["Sergey Shelukhin (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680867#comment-14680867 ] 

Sergey Shelukhin edited comment on HIVE-10289 at 8/10/15 10:18 PM:
-------------------------------------------------------------------

Hi. I am not sure what this patch is using (it's too big and no RB or description ;)), but HBase has a built-in serialization helper for sorted, multi-type keys called OrderedBytes: https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/util/OrderedBytes.html and HBASE-8201
I think we should use that


was (Author: sershe):
Hi. I am not sure what this patch is using (it's too big and no RB or description ;)), but HBase has a built-in serialization helper for sorted, multi-type keys called OrderedBytes: https://hbase.apache.org/apidocs/org/apache/hadoop/hbase/util/OrderedBytes.html and HBASE-8201

> Support filter on non-first partition key and non-string partition key
> ----------------------------------------------------------------------
>
>                 Key: HIVE-10289
>                 URL: https://issues.apache.org/jira/browse/HIVE-10289
>             Project: Hive
>          Issue Type: Sub-task
>          Components: HBase Metastore, Metastore
>    Affects Versions: hbase-metastore-branch
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>         Attachments: HIVE-10289.1.patch
>
>
> Currently, partition filtering only handles the first partition key and the type for this partition key must be string. In order to break this limitation, several improvements are required:
> 1. Change serialization format for partition key. Currently partition keys are serialized into delimited string, which sorted on string order not with regard to the actual type of the partition key. We use BinarySortableSerDe for this purpose.
> 2. For filter condition not on the initial partition keys, push it into HBase RowFilter. RowFilter will deserialize the partition key and evaluate the filter condition.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)