[jira] [Commented] (HIVE-7231) Improve ORC padding

["Lefty Leverenz (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-7231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14088990#comment-14088990 ] 

Lefty Leverenz commented on HIVE-7231:
--------------------------------------

The wiki now documents *hive.exec.orc.default.block.size*, *hive.exec.orc.block.padding.tolerance*, and the changed default for *hive.exec.orc.default.stripe.size* in 0.14.0:

* [Configuration Properties -- hive.exec.orc.default.block.size | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.default.block.size]
* [Configuration Properties -- hive.exec.orc.block.padding.tolerance | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.block.padding.tolerance]
* [Configuration Properties -- hive.exec.orc.default.stripe.size | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.default.stripe.size]

> Improve ORC padding
> -------------------
>
>                 Key: HIVE-7231
>                 URL: https://issues.apache.org/jira/browse/HIVE-7231
>             Project: Hive
>          Issue Type: Improvement
>          Components: File Formats
>    Affects Versions: 0.14.0
>            Reporter: Prasanth J
>            Assignee: Prasanth J
>              Labels: orcfile
>             Fix For: 0.14.0
>
>         Attachments: HIVE-7231.1.patch, HIVE-7231.2.patch, HIVE-7231.3.patch, HIVE-7231.4.patch, HIVE-7231.5.patch, HIVE-7231.6.patch, HIVE-7231.7.patch, HIVE-7231.8.patch
>
>
> Current ORC padding is not optimal because of fixed stripe sizes within block. The padding overhead will be significant in some cases. Also padding percentage relative to stripe size is not configurable.



--
This message was sent by Atlassian JIRA
(v6.2#6252)