You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Prasanth J (JIRA)" <ji...@apache.org> on 2014/10/30 18:44:35 UTC

[jira] [Commented] (HIVE-8650) Byte align ORC's rle v2 patched base

    [ https://issues.apache.org/jira/browse/HIVE-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190458#comment-14190458 ] 

Prasanth J commented on HIVE-8650:
----------------------------------

[~owen.omalley] Since we are considering 90th percentile value now, 10% of values can qualify for patching. So we need to update patch length size in preparePatchedBlob()
{code}
    // since we are considering only 95 percentile, the size of gap and
    // patch array can contain only be 5% values
    patchLength = (int) Math.ceil((numLiterals * 0.05));

    int[] gapList = new int[patchLength];
{code}

Even better if we can pull these constants out to static finals.

> Byte align ORC's rle v2 patched base
> ------------------------------------
>
>                 Key: HIVE-8650
>                 URL: https://issues.apache.org/jira/browse/HIVE-8650
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Owen O'Malley
>            Assignee: Owen O'Malley
>         Attachments: HIVE-8650.patch
>
>
> Currently the ORC rle v2 doesn't align patched base chunks, even if the user has chosen to byte align the encoding.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)