You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by Abhijit Pol <ap...@rocketfuelinc.com> on 2009/09/05 01:48:21 UTC

column based storage in hive

Hive supports column based storage using RC files.
https://issues.apache.org/jira/browse/HIVE-352

The question is: if I store hive tables in this format and once in a
while would like run some custom map-reduce jobs against the data in
this table, am I restricted in any sense?

Thanks,
Abhi

Re: column based storage in hive

Posted by Zheng Shao <zs...@gmail.com>.

You can use Hive's TRANSFORM clause to do hadoop-streaming-like custom
map-reduce jobs.
You won't be restricted in any sense.

Zheng

On Fri, Sep 4, 2009 at 4:48 PM, Abhijit Pol <ap...@rocketfuelinc.com> wrote:

> Hive supports column based storage using RC files.
> https://issues.apache.org/jira/browse/HIVE-352
>
> The question is: if I store hive tables in this format and once in a
> while would like run some custom map-reduce jobs against the data in
> this table, am I restricted in any sense?
>
> Thanks,
> Abhi
>

-- 
Yours,
Zheng