You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Tom White (JIRA)" <ji...@apache.org> on 2011/09/20 22:42:08 UTC
[jira] [Updated] (HIVE-2457) Files in Avro-backed Hive tables do
not have a ".avro" extension
[ https://issues.apache.org/jira/browse/HIVE-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HIVE-2457:
----------------------------
Attachment: HIVE-2457.patch
Here's a patch which introduces a new property, {{hive.output.file.extension}}, that SerDes can set to control the file extension. If not set, it falls back to the current rule: add a codec extension (e.g. ".gz") only in the case of text files.
I've tested it by modifying Haivvrreo to set the new property (https://github.com/tomwhite/haivvreo/commit/899a2c44cd25aca6c469d6c2fdb8419e66dda380). With this change I see that new files in an Avro-backed table created by Hive have a '.avro' extension.
> Files in Avro-backed Hive tables do not have a ".avro" extension
> ----------------------------------------------------------------
>
> Key: HIVE-2457
> URL: https://issues.apache.org/jira/browse/HIVE-2457
> Project: Hive
> Issue Type: Improvement
> Components: Query Processor, Serializers/Deserializers
> Reporter: Tom White
> Attachments: HIVE-2457.patch
>
>
> When using the Avro SerDe (see HIVE-895, https://github.com/jghoman/haivvreo) the files created for an Avro table do not have a ".avro" extension, which causes problems for tools like Avro MapReduce or Sqoop which expect the extension.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira