You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Krishna Kumar (Commented) (JIRA)" <ji...@apache.org> on 2011/12/06 09:33:40 UTC

[jira] [Commented] (HIVE-2623) Add Integer type compressors

    [ https://issues.apache.org/jira/browse/HIVE-2623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13163437#comment-13163437 ] 

Krishna Kumar commented on HIVE-2623:
-------------------------------------

RCFile size stats:

   gzip/bzip2/uber+compressor

steppedpowerlaw1S 49455/45746/36168(IntegerEliasGamma1S)
steppedpowerlaw2S 61425/56546/35998(IntegerEliasGamma2S) 
steppedpowerlawTimestamp 120895/201378/35875(DeltaIntegerEliasGamma1S)
steppedpowerlawIQ 84818/54463/36125(DeltaIntegerEliasGamma2S)
                
> Add Integer type compressors
> ----------------------------
>
>                 Key: HIVE-2623
>                 URL: https://issues.apache.org/jira/browse/HIVE-2623
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Query Processor, Serializers/Deserializers
>            Reporter: Krishna Kumar
>            Assignee: Krishna Kumar
>            Priority: Minor
>         Attachments: HIVE-2623.v0.patch, HIVE-2623.v1.patch, steppedpowerlaw1S.gz, steppedpowerlaw2S.gz, steppedpowerlawIQ.gz, steppedpowerlawTimestamp.gz
>
>
> Type-specific compressors for integers.
> Starting with elias gamma which prefers small values as per a power-law like distribution. 

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira