You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Brian Muller (JIRA)" <ji...@apache.org> on 2011/08/25 15:46:30 UTC
[jira] [Created] (HIVE-2407) File extensions not preserved in
Hive.checkPaths when renaming new destination file
File extensions not preserved in Hive.checkPaths when renaming new destination file
-----------------------------------------------------------------------------------
Key: HIVE-2407
URL: https://issues.apache.org/jira/browse/HIVE-2407
Project: Hive
Issue Type: Bug
Affects Versions: 0.7.1
Reporter: Brian Muller
In the checkPaths method of Hive.java, a new destination filename will be chosen if the source filename already exists in the destination directory. This new filename follows the simple schema of adding _copy_N to the source filename (with increasing N until a non-existing filename is found).
If the file has been LZO compressed it is imperative that the extension remain ".lzo" so that the LZO indexer can find it and create a corresponding index file. It would be much better to use a prefix of "copy_N_" or insert "_copy_N" somewhere else in the filename.
Without this, Hive and LZO compression will not work when identical source filenames are inserted into Hive.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-2407) File extensions not preserved in
Hive.checkPaths when renaming new destination file
Posted by "Ashutosh Chauhan (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan resolved HIVE-2407.
------------------------------------
Resolution: Fixed
Fix Version/s: 0.8.0
This got fixed as part of HIVE-2296.
> File extensions not preserved in Hive.checkPaths when renaming new destination file
> -----------------------------------------------------------------------------------
>
> Key: HIVE-2407
> URL: https://issues.apache.org/jira/browse/HIVE-2407
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.7.1
> Reporter: Brian Muller
> Fix For: 0.8.0
>
>
> In the checkPaths method of Hive.java, a new destination filename will be chosen if the source filename already exists in the destination directory. This new filename follows the simple schema of adding _copy_N to the source filename (with increasing N until a non-existing filename is found).
> If the file has been LZO compressed it is imperative that the extension remain ".lzo" so that the LZO indexer can find it and create a corresponding index file. It would be much better to use a prefix of "copy_N_" or insert "_copy_N" somewhere else in the filename.
> Without this, Hive and LZO compression will not work when identical source filenames are inserted into Hive.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira