You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Lefty Leverenz (JIRA)" <ji...@apache.org> on 2017/12/05 08:49:00 UTC
[jira] [Commented] (HIVE-17600) Make OrcFile's "enforceBufferSize"
user-settable.
[ https://issues.apache.org/jira/browse/HIVE-17600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16278213#comment-16278213 ]
Lefty Leverenz commented on HIVE-17600:
---------------------------------------
Doc note: This adds *hive.exec.orc.buffer.size.enforce* (aka *orc.buffer.size.enforce*) to OrcConf.java. I guess it should be documented in the ORC section of Configuration Properties, although that section needs an explanation about the move from HiveConf.java to OrcConf.java.
* [Configuration Properties -- ORC File Format | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-ORCFileFormat]
Added a TODOC2.2 label.
> Make OrcFile's "enforceBufferSize" user-settable.
> -------------------------------------------------
>
> Key: HIVE-17600
> URL: https://issues.apache.org/jira/browse/HIVE-17600
> Project: Hive
> Issue Type: Improvement
> Components: ORC
> Affects Versions: 2.2.0, 3.0.0
> Reporter: Mithun Radhakrishnan
> Assignee: Mithun Radhakrishnan
> Labels: TODOC2.2
> Fix For: 2.2.1
>
> Attachments: HIVE-17600.1-branch-2.2.patch
>
>
> This is a duplicate of ORC-238, but it applies to {{branch-2.2}}.
> Compression buffer-sizes in OrcFile are computed at runtime, except when enforceBufferSize is set. The only snag here is that this flag can't be set by the user.
> When runtime-computed buffer-sizes are not optimal (for some reason), the user has no way to work around it by setting a custom value.
> I have a patch that we use at Yahoo.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)