You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Tom White (JIRA)" <ji...@apache.org> on 2011/09/20 22:42:08 UTC

[jira] [Updated] (HIVE-2457) Files in Avro-backed Hive tables do not have a ".avro" extension

     [ https://issues.apache.org/jira/browse/HIVE-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tom White updated HIVE-2457:
----------------------------

    Attachment: HIVE-2457.patch

Here's a patch which introduces a new property, {{hive.output.file.extension}}, that SerDes can set to control the file extension. If not set, it falls back to the current rule: add a codec extension (e.g. ".gz") only in the case of text files.

I've tested it by modifying Haivvrreo to set the new property (https://github.com/tomwhite/haivvreo/commit/899a2c44cd25aca6c469d6c2fdb8419e66dda380). With this change I see that new files in an Avro-backed table created by Hive have a '.avro' extension.

> Files in Avro-backed Hive tables do not have a ".avro" extension
> ----------------------------------------------------------------
>
>                 Key: HIVE-2457
>                 URL: https://issues.apache.org/jira/browse/HIVE-2457
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor, Serializers/Deserializers
>            Reporter: Tom White
>         Attachments: HIVE-2457.patch
>
>
> When using the Avro SerDe (see HIVE-895, https://github.com/jghoman/haivvreo) the files created for an Avro table do not have a ".avro" extension, which causes problems for tools like Avro MapReduce or Sqoop which expect the extension. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira