You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Prasanth J (JIRA)" <ji...@apache.org> on 2014/10/30 18:44:35 UTC
[jira] [Commented] (HIVE-8650) Byte align ORC's rle v2 patched base
[ https://issues.apache.org/jira/browse/HIVE-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14190458#comment-14190458 ]
Prasanth J commented on HIVE-8650:
----------------------------------
[~owen.omalley] Since we are considering 90th percentile value now, 10% of values can qualify for patching. So we need to update patch length size in preparePatchedBlob()
{code}
// since we are considering only 95 percentile, the size of gap and
// patch array can contain only be 5% values
patchLength = (int) Math.ceil((numLiterals * 0.05));
int[] gapList = new int[patchLength];
{code}
Even better if we can pull these constants out to static finals.
> Byte align ORC's rle v2 patched base
> ------------------------------------
>
> Key: HIVE-8650
> URL: https://issues.apache.org/jira/browse/HIVE-8650
> Project: Hive
> Issue Type: Improvement
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Attachments: HIVE-8650.patch
>
>
> Currently the ORC rle v2 doesn't align patched base chunks, even if the user has chosen to byte align the encoding.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)