[jira] Updated: (HIVE-417) Implement Indexing in Hive

["He Yongqiang (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

He Yongqiang updated HIVE-417:
------------------------------

    Attachment: hive-indexing-8-thrift-metastore-remodel.patch

Attache a new patch for review. Added metastore remodeling based on offline discussion with John and Paul.

Also addressed namit's suggestions: "Instead of proposing a new syntax, why dont we use 'alter index <INDEX_NAME> ON <TABLE_NAME> REBUILD;"

@Ashish,
>>Also, how would this be used to query the table? Can you give an example?

Added four test files in clientpositive. You can now refer thoee files for examples.

An example from one qfile:
CREATE INDEX srcpart_index_proj TYPE COMPACT ON TABLE srcpart(key);
ALTER INDEX srcpart_index_proj ON srcpart REBUILD;

SET hive.input.format=org.apache.hadoop.hive.ql.io.HiveInputFormat;
INSERT OVERWRITE DIRECTORY "/tmp/index_test_index_result" SELECT `_bucketname` ,  `_offsets` FROM default__srcpart_srcpart_index_proj__ x WHERE x.key=100 AND x.ds = '2008-04-08';
SET hive.exec.index_file=/tmp/index_test_index_result;
SET hive.input.format=org.apache.hadoop.hive.ql.index.io.HiveIndexInputFormat;
SELECT key, value FROM srcpart WHERE key=100 AND ds = '2008-04-08';

Will update the patch and open follow up jiras after get more comments. 

Thanks
Yongqiang

> Implement Indexing in Hive
> --------------------------
>
>                 Key: HIVE-417
>                 URL: https://issues.apache.org/jira/browse/HIVE-417
>             Project: Hadoop Hive
>          Issue Type: New Feature
>          Components: Metastore, Query Processor
>    Affects Versions: 0.3.0, 0.3.1, 0.4.0, 0.6.0
>            Reporter: Prasad Chakka
>            Assignee: He Yongqiang
>         Attachments: hive-417.proto.patch, hive-417－2009-07-18.patch, hive-indexing-8-thrift-metastore-remodel.patch, hive-indexing.3.patch, hive-indexing.5.thrift.patch, indexing_with_ql_rewrites_trunk_953221.patch
>
>
> Implement indexing on Hive so that lookup and range queries are efficient.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.