You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by Martin Konicek <ma...@gmail.com> on 2011/08/03 19:10:51 UTC

Indexing .gz files

Hi,

can indexes work on gzipped files?

The index gets build without errors using
ALTER INDEX syslog_index ON syslog PARTITION(dt='2011-08-03') REBUILD;

but when querying, no results are returned (and no errors reported). The 
query should be correct because with plaintext files it works.


Best regards and thanks
Martin Konicek

Re: Indexing .gz files

Posted by Martin Konicek <ma...@gmail.com>.

Thanks! Can Hive index LZO compressed files then? LZO compression isn't 
part of Cloudera's release, right?

On 03/08/2011 19:38, yongqiang he wrote:
> unfortunately it does not, because can not split .gz file.
>
> 2011/8/3 Martin Konicek<ma...@gmail.com>:
>> Hi,
>>
>> can indexes work on gzipped files?
>>
>> The index gets build without errors using
>> ALTER INDEX syslog_index ON syslog PARTITION(dt='2011-08-03') REBUILD;
>>
>> but when querying, no results are returned (and no errors reported). The
>> query should be correct because with plaintext files it works.
>>
>>
>> Best regards and thanks
>> Martin Konicek
>>

Re: Indexing .gz files

Posted by yongqiang he <he...@gmail.com>.

unfortunately it does not, because can not split .gz file.

2011/8/3 Martin Konicek <ma...@gmail.com>:
> Hi,
>
> can indexes work on gzipped files?
>
> The index gets build without errors using
> ALTER INDEX syslog_index ON syslog PARTITION(dt='2011-08-03') REBUILD;
>
> but when querying, no results are returned (and no errors reported). The
> query should be correct because with plaintext files it works.
>
>
> Best regards and thanks
> Martin Konicek
>