You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Lefty Leverenz (JIRA)" <ji...@apache.org> on 2014/08/10 00:07:12 UTC
[jira] [Commented] (HIVE-5728) Make ORC InputFormat/OutputFormat
usable outside Hive
[ https://issues.apache.org/jira/browse/HIVE-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14091923#comment-14091923 ]
Lefty Leverenz commented on HIVE-5728:
--------------------------------------
This added four configuration parameters to HiveConf.java in 0.13.0.
* *hive.exec.orc.default.row.index.stride*
* *hive.exec.orc.default.buffer.size*
* *hive.exec.orc.default.block.padding*
* *hive.exec.orc.default.compress*
Note that the first parameter the patch changes just adds a line break -- *hive.exec.orc.dictionary.key.size.threshold* was added by HIVE-4324 in 0.12.0.
The four new parameters are documented in the wiki here:
* [Configuration Properties -- hive.exec.orc.default.row.index.stride | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.default.row.index.stride]
* [Configuration Properties -- hive.exec.orc.default.buffer.size | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.default.buffer.size]
* [Configuration Properties -- hive.exec.orc.default.block.padding | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.default.block.padding]
* [Configuration Properties -- hive.exec.orc.default.compress | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.exec.orc.default.compress]
> Make ORC InputFormat/OutputFormat usable outside Hive
> -----------------------------------------------------
>
> Key: HIVE-5728
> URL: https://issues.apache.org/jira/browse/HIVE-5728
> Project: Hive
> Issue Type: Improvement
> Components: File Formats
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.13.0
>
> Attachments: HIVE-5728-1.patch, HIVE-5728-10.patch, HIVE-5728-2.patch, HIVE-5728-3.patch, HIVE-5728-4.patch, HIVE-5728-5.patch, HIVE-5728-6.patch, HIVE-5728-7.patch, HIVE-5728-8.patch, HIVE-5728-9.patch, HIVE-5728.10.patch, HIVE-5728.11.patch, HIVE-5728.12.patch, HIVE-5728.13.patch
>
>
> ORC InputFormat/OutputFormat is currently not usable outside Hive. There are several issues need to solve:
> 1. Several class is not public, eg: OrcStruct
> 2. There is no InputFormat/OutputFormat for new api (Some tools such as Pig need new api)
> 3. Has no way to push WriteOption to OutputFormat outside Hive
--
This message was sent by Atlassian JIRA
(v6.2#6252)